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(54) [%9qiD«»] ^PTKnm^. 4«ffi]Sftj2yi$^GI:&J:r^tttK{t: 



(CT) 



1 4 




SB 



5 

64 



(2 

1 

[iil*«2lit^fllfcfcV^T. 
[if*«4]it*]Slfc:t3V^T. 20 

<tt,-*TJ>'5. 

^t^mibthmmm^m.. 50 



!^ra¥10-3 53 20 

2 

mm9\wm(>\izii\yc. 

^BffliS:*t. iE^HHfc:Bfili&^5rrs^:S^a 
^(>izmt. 

±iaftm$*T^B«T-:?S:St. ±Sffl«OBmS:. -e 
<Dmmmim^<7):k^^iz^i>idtz. JfeAiifcJili 

*#g^. ^i^^zmt?>ztinwltfhmmmm^ 
3!!^a. 

[ii*]Hi 2 1 if*]B 1 1 ttsv^r. 

x-^tiJftl.#B«cofeffl<Offla^»c, ±iB«B<^ 
jBIE^co. Si>J:r^B<^-^:<i:t>-^r«^B»x-:?S: 

mmmmm, 

iSBEmom&^mzx*). iJsiiig#*«giso*-c* 



(3) 
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±s>m=t-Ymm.^mi. 20 

J: d izmkt Jtti^h tt , JiS^S^M^o^BHco 30 

mmt. 40 



50 



immmizisi tT±fEsw<^ff *tii t Mm^cni^ 

[fi^ 1 8 ] 11^ 1 1 tiJl >T . 

[ffSJi 1 9 ] msm 1 1 ^zti\,^x. 



m^Asm<7)smmti^izfm^tu^miiwmi>si 

±M*ai#afc J:tX±fSSPi*- KMr^SJi. 



I 1 7 ] 1 6 1 V ^-c . 



[00011 

nm't- K ^mft&mmmsLfn^mtzmrh i><r> 
x'iih. 

[0002] 

- 6 8 5 0 0^^St:^S<i7t:¥ra«£ 
-t. !mS6 2-12159 9^^t;:{i$Bi^ff:^r 

isntfrioBmr-^w't'*^^. wmyyycomm'f-if' 

- 1 5 1 3 4 l^i^Wi. ^MhW^B®*^'^. sis 



(4) 
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[00031 

•9. Bm^mmT-^^minLx^^t, mm 
[ 0 0 0 4 ] -e^-e. ^mxit. ms^mtTi^-H/i- lo 

[0005] 

[0 0 0 61 tti. ^^mrcii. JMfom^mmwj 20 

[00071 

mMmiziiuti. jRmmM^j::^y-mmmmmiz 

[00081 mm. mmf:. ±mm(m^<Dm 
stc. mi^mm'\'Xi>h*^i}-^m:thztii^ 

< fc i>-A<omk attiL/iBfiiT-:?^aK, ttai 

$tL^fflc7)B®S:. ^(r>^miim^cr^t^iz^j:t 
[ 0 0 0 9 1 S 4. :^mx\i. ?haJ*>^.<0«®*- 

mfi^itiiiM9\-itmixmm'-:^ ^]R#-ti.sm 



i-ma^stk. aaj^fi^B^iT-^'^fflv^T, 

^2.559*- HUff ^Sfc i&fili. i.$S5fflB®3!!S^a 
[ 0 0 1 0 1 ::<o i 3 tttuf , HSS^^Sl: 

m^mtm (m^(r>m. mmc^m^. m& 
(rmn<7mm. mm)j<r>mm) tm^Hitii^mz 
x-^xmta^ti. ^<7)iiiiiif-is^izM\yzmmtvf:im 

fiiF5:Bfia!!«^B*«iifl^5*J.S . 
[00 1 1 1 3!!yit-Ht«. mtii. JgflSOi^- 

[ 0 0 1 2 1 ai^, m&^<oi^yx^izeitx9m 

HBt. i^yx^^m*)^tiismmmtmk. 
lyyx^ifiwosithtihk. ]yyxismi:^mt 

-i^mi^mz. i^yxmmi^-tmimm^tii 
k. mmizp^tx. mL^t-Y^mR-th^mwiif 

[00131 i^, E^iiaEftdC (^I118S);&-H 

^if) <^mmL*)^izf6tx. jrat-K$-]^LT 

mim.im;^m^izx^m;^Jii^k. am 
t-K]^*gtt. m:mhtu:imnzm\:,x. nsM't: 

iti^ti. smmm^m^izx*}m:^issLhtifzy 

[00141 j:a<^)#«uat- Y\znmhtL^\z\t. 

#tts#at. >^'yyxm^t~Y<r)m.^^vs¥tV!h 
m.k. wt-Yommi^mvfhmck. 

[0015] mm^c^-Y^^-thtdh\z\t. a 

^fc:fc(t-&#B^c7)feffl<^ffia$r^t^ $MiOi»£« 
to. fflt>J:I^@iOi!'-5:< k t-^r-^BMr-^S-tttiJ-r 



7 

[0016] yN'7yx«iajt-HS^»s^sJti6tui. 
[00171 lit- KS'i^-rsiti^tcfi. «iaj#a 

[0018] lirfr^t- K SrSeS-r S Jti^trJi, tttU 

ztimtt\'\ mmw&mizii. mm. m^co 
M*#±$-frs) $Btt® (mzMm\fiff>^) ^ 
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8 

S>^:S J: d fcggx S ) ^i:ip$>t . 
[ 0 0 1 9 ] ^ri5, 5 ^-5^ , ^»^AIt 

7-i:t, ^BffiJr. Zff)J\-y^y-<7)mi>zSMt 

ixo iz-nui. mf^<m(^ti/::x^-ximiizmm 

\m§i^li. ^BiBt:BfiW)«^§*fCv^SJ®^. S 

mm^^-y^y-^^txmttiztii^T^. t 

[00201 *l|HaT«. KSrieS^Sfci^) 

mmii^bLxii. mm. ic;<^-k, at^T^-r, 

M (Read Only Mencry) mS^l^^MfZi 

0 mPi-JR *) isrig'Srfflffij&^^^i.S t cOT'fcixKi: to J: 

[00211 

20 [liit(W] £1T. *%BB<OllSSW2-affl2rfflV^-CiPiHllift 
BfTS. ^r43. :*^l*Sfia|<0$iWBa«^Mtt. i» 

m(>tvf. mm-mmmi:(nmmLxi>x\,\ t 
3t. ^jm. m. mm:izizm\^hzti>x^h. 

[002 21 (l)>'N-K'>XTfl}jS 

01 ( 1 ) t, *^Mc0B««i^S<0^«^5^-r. 
2|M0l|(OBfi&j!^S(i. 1 1 7 ^ . Stft^ 1 0 
6b. «ai^l04i:. a^iafl|10 2af:S-fili.. $ 

i^izms izm-rm^ 3 o 2 Srfiix * . 

30 [002 3ia^18l02a«. **117«±aJt 

is»t/i>iT^ a^aar* 1 0 2 1 . -^-wsftja?'* 102 

1 0 lfc3{pf>^:S, r^' y^^>'M01{i2|sBMa 

^ls*•*^w^'^•rl 1 i^fcs^-rsfei^coafflT* 

0. mm. ^"J-yT«OJ:d^t>c02r>I<or^'-yf-^y 
MOlfcLTffll-^SClfcj&^-Cg^S. ^"J-yT5:fflV^5 
J^Wi, SBtO-tW^^lf 1 1 1^5r^:<7)r^'>yf-^ 
yM0 1'C«a§^I.C:fct=J:0, *B«*5iSIB5:@ 
^^C:t*«-Cl=&. :*^att. *f*ci 1 

40 immE^iznsii^-ttzbij^xt. ttiu^^j: 
muzM'omfhzbiiix^. Mf>%i3Xrm!^Wji 
mizmthmt/'xti, :mm&mm<7)'mii. 

v;«r-7^^'y^-/MO4tJ:0ffi»S$n5. ^SriJ. 
BjgJi. *limjill*»'i>offi*&TtJ:<, ^(^iz. ismi 

mi:-^mizi-i,ZbijiX^t. 

[ 0 0 2 4 1 ^t5, ^mmmcrmmssmmn. mm: 

10 6 fc3|sfr 1 1 7*^0 1 ( 1 ) (cs^-rj; a liZH^z^ 
-?TV»S*«. 02t^-rJ:-3tSiJ'<ffcL'rt>j:V\ 02 

50 iz^-tm^nsi^mrcii. 02 ( i ) t^r^i-iat^. » 



9 

^yMOlfciO. a«l^l 0 63&«HSStil.. 

S. g«^10 6{iillSfia512 0afc«aiU'fvf-l 
08ai&fi|;l, iligffia512 0t*«sl 0 7<O3*S^ia5 

1 2 0{i. ms^ttiaitJ: *)Wi^^tix\^i>. zcox 

0 iztiua. 10 6^. mmE^tznm^'t 

[0025] 4«isei«^s*fr 1 1 7 ti. ff^mzmsi 
Jiffies (fi'^mMHs^m. (@*^) fc^tu 5 0 

llTttt. HI (2) tc^-ridfc. IC;&-H#A 
□ 10 3. t-KflJOJftxX-f -7^-10 5. X-A^ 
X>f-/f-10 7. fl^-f-yf-108. mSit-^'^y 

no 9, mf^^-:}^yyTiio, mam^x^-y^ 

112. Xlf-;<^1 13. ^ggaJASSl 14. 
Jliaitemt-^ 7^7-1 1 5*«iHt'^flTV%S. 
[0 0 2 6] IC;*-KifAai 0 3t{±. IC;*-H 
*><5>il*JR-5yt:<f«&*f*cl 1 7<0ffi«j!P^at:iltt 
•ri, I C;*-HgE;^]R>9«?5 8 (04t0S^) *««|;t<?> 

AP10 3i=IIL)i^*i:tIC;!>-H (#a<0«SlgS:ll 

[0027] mm^io6ii/iy-mmnisft>'). # 

tLTV^S. ii3t. X-ApS;;?.-f -yf-i 0 7fcrJ:»?. 

[OO28]«^S3O2«m03t5^i-. :*^iS«?l 
<^)^S§3 0 2ii^mcr>tRi'^-iS'X'h 0 . M3 0 4 

fc^^fc«^<7)j»#«fj>s v^ttjiiK«t&-&i?->^N'^ -ri 

1 ItcrtiE^n-CV^I.. ^rts. ^S§3 0 2i:L-C. 

mi}mmim\^xi>x\<\ ^^3 0 2t^a^a5^j 
ati 1 4fc{i. miizx *)mm^ixx\^hti^. nmm. 
mw:f:itLxmiizx<on^mLxi>x\>K ;iff)Xoizi- 
tm. mtii. *«ci 1 liMmz. ^^^302?:$ 
mmm-i^j:t\ mizmwmimm-^nbtfix 

[00291 ^mm-ii. 0 2<7>^mb^ 

fc3Kf4^L. ^*^^>Altt^3K«±Rltf-S^WS5 
-fct. >!:covN-7 55-<?5aHt:^S3 0 2oa^ 
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1 0 

ammiii. ^mmizmmp^^tcc^-^t^. m 
mmf^-yiy-i:mLxm.thzbm'^. t 

y ^~izm^tu::m(ojit&^mg.-rh ^ttfix^ 
i(ox. m^<^t>titi:^^-xi^i^mx^t. 
mmiz^ ^y^u-fi 1 i<Dm3 04i/\-y5.y-t 
L. ;i(^izm^3 0 2ffm^mm^wtifxLx\>\ 

[00301 (2) >'X7'J^m& 
10 2l^«i0B«9!!^SO5^XTA«|^^. 04 {CS^ 

26fc. 3(aSI^2 8t5:iii.i.. 

[00311 im^2 4tt. X-A«818a52 . X-A 

fc. CCD («^^^) Xr^^lOt. A/D^ 
Sl2i:. felS^IlI»14k5rfi|;cS. X-AWmSi 
2t3j:t^X-A^a54«. affiSaiOfg^Sr^xSt, 

wS)*. T-f ux««gu6tjj:i/r^yx^a58 
{i. wMWi-tibtimmmm^^^^'h^izim^ 

*)^m<zbizxt). w^momh^imiE^b-r 

i>. ^ii>ltZy*-:^XCommi>fTO. CCD;<^;<^10 

uj/fi^tiairr&. A/Dssmsi 2 a. ccd;^^ 
7 1 o*>^aj:»3<tJtr-^n^^«wt^^Ti''^';Wi^ 

iz^mt&. ■fell^lII»14J4. "f'J^flM^bLX 
gJtJRofc1ft!?«a^)=Kfe (R (#) . G (S) . B 
(») ) m^*»S<i^Y. feints (R-Y. B- 

Y) <rmmmmiz^-ftm,xhh. mmm, 

30 ^ (Y. R-Y. B-Y) Ji. RGBft^^fflV^T. JJl 

[00321 R' = R-rR 
G' = G-rG 
B' = B-rB 

Y = 0.3R'+0.6G' + 0. IB' 
R-Y = 0.7R'-0.6G'-0. IB' 
B-Y = -0.3R'-0.6G' + 0.9B' 
ClClT. fe5|py'>f y (rR. rG, rB) li. ftaj^ 

^a53 8fcio^3<is<reS)S. lasp^^'^f^ 

40 {4. ii^. ( 1 , 1 , 1 ) im^^tlX\.^ttz^. »® 

b t fc»4. 1 i 0:*:$ mm§k 
imh»)\iZ}&^^ixh . 

[0 03 31 ^s^2 6«. mmmeb. mmn, 

18k. xvri-^»20k. ^Sai:»]ia5114k 
S-fiiiS. jiSHISSl 6(4. i!Plg528T'®^'5:*ra^ 

nL. mLm2Sifit:><n9m^^m3i-^h^hm,x' 

50 hh. xy3-^I5i?S2 0{4. a«IIilSSl 8T3iPI$ii 



(7) 

1 1 

tifmW^im^^im'O . NTSC (National Telev 
ision Systei Comnittee) ^^t:^^S0!8-Cfc 0. 

NTS cmmi^^tam iiAiift txmwmsi 

[0034] ^S302li. NTSCm^^SltJR 

mmzmmt^^si:. ^^izmmmmRi-hztusi 
[0035] >mm2 ffiist^gs 3 0 bmm 

[0036] mtammi^s eti. < -o<7)iittgs- 

fr^a538J:'9iSft$*i:t«iaife^T-:J' (^tSi 

mtt ) izm^-tmmimsi y±x(o. 20 
^mmtzntt&^ (±-h±if*) ) tm. (iL-hn^ 
*) ) commT-i5^ (X./ i/ssr-^' ) immm 1 s 
}ixx/mm3 2izm.mu ^t,iz. mta^^kmzmM 
i-hmmmt*)iznLX:^^y^ytmmy^ym 

m2izmmtib\>^m^xs>t. 1 3-0(4, am 
m^'pxm^mmco&T-i^ (y, r-y. b-y) 

[00371 mta^m^S 8«, 30 
T^^ y 5 0fc:iBeL-Ci)Sttai-r5J»^!|i)<7)»*flt):5: 
fer-:}' (Y, R-Y, B-Y) i:«jaj«HllIK3 6-C 

■9-yryy^^LitfeT-:J' (y, r-y. b-y) ^t, 
ttttaji^T-^'^^t, ttaj5{iaiHis&3 6fc:ii 

MLX. ^^-Vizhiy^X^=f:V5 0izmitXf>i 

L5^:feT-^ (Y. r-y. b-y) ihbiz^mi 
^LX. mmL. $<5>t, felg5»lllS8l4-ec^^ 

my^y(rfi. tg, rB) ^^i^s, 4o 

[00 38] 5:iJ. ttai*fr«ll^38{i. 

1 7<Offi«J!UiilBlc;J:'3ll3S$ns. t^*)^. 

U 5 0 tftRSiiJtrn^'^AS-, ffiaas^ScO+iJi 
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1 2 

t'^h^biizi.^mth, tt:. wm^^mm 

*>. Hfe. ^^^^^W^x-rJ't-rS. X 

*e<|^T-^'«. F(cS)^5-li:-C^* y 5 0 

rntixh 0 , icofeT-^'J4ttaj^^sP3 

\^m!^n •) □ 1 0 3-^c^ I C HOU LWHz^: 
Os ftSv^{4t-h'flJ")#i.x>f «yf-10 5<7)*t®t:J; 

[0040] IC;&-K151<0fiM$-ri.T-:?<0rtS 

01 OtlS^-r. I C;*-K1 5 H4, 
T-^'S:EeLTi«^S«H^-H=&««l 5 1 li:, 

I. 

[0041] ^=eV50<0^mi-hf-:!fff)n^i. H 
9t:^. 5 0Ji. ROM(READ ONLY MEMORY)^ 

5 0 a t R AM(RANDOM ACCESS MEW)RY)«iS 5 0 b t 
*><i>=SrS, ROM««5 0a«. :*^S^$lJfflI1-S** 
7-D^5A^fiMttSffi«14 1fc, 

1 4 2 i: , :mmiz\^m(0^~ K tJtlBL^ 
f JBraJrn^^^ASrtSlJ^^S^ 1 4 4 1 , 

Sr-^'^^a^T-:? fc Lxm^&mi 1 4 3 i: Sr 

»4«^t!tT-^' {s:ajT-^'5oo6 (Beta 

S^) ) &-iBfWfc:fiat-r4fei6co»{lir-:?iE1t«lil 
4 5i:. IC;<^-h'l 5lcOF^i&IX'3iitf««14 6 

7i:Sr<ii.S. IC;<f~Kl SK^rt^SrBXOatffii^ 

^SS^T-^'fc^ftij-ti-C. *J9lT-:J'5 0 04 (0 
6t0^) 

[00421 ^t^iifeMcoHiiUdH^aji, ttiij^Rt t 

X. ±jitcO^m2 6tiXX/^m3 0 2liZlsalX. ^ 
(>^e-;&> 1 13, i(!iae«*-:?5y7-i 1 
5. teJ:lX|6f^tr::^'7y7-l 10S:fili.S. ClilfecO 

aj:^^si4. mm 2xm\Lt:m:^M^izmi 
[ 0 0 4 3 1 $ (i> :^s^fi?«(^B«3!aaii»4, m 

jffift«iJ«I^S54t$M*tlHr>-9-56fc^fii;tS. $ 
fi^i&MISra53 2tSfS^-l.. 



1 3 

[0 0441 W!irg|53 2«, gB*ft 1 1 7c0ffi^J!Ul 

[ 0 0 4 5 ] ^:t5. aaj^«^3 8 

ISg«ilHl!8l4. 1S1I11S&18. xya-^^mSf. fttB 
*!SII51g&3 6) {±. ^t'J5 0tcfiM#§ixJt7-n^<7A 

[00461 (3)fmm 

[0 04 71 mSX^ y^l 0 8*«3r>'t;$<lSfc (X 
x-/rs2) . flK*53 2ti. «cl^lBr2r^f^ 

cof-x -y ^' t . 2 4 (7)^Bri: ijfiS . -t^h 

wmn^^mf^-s=jyT\ i o<?)^jgn-Htcj: o 

[0048] 4J(»*J5rV^. Wmi 4 A»\ U 5 

0 fcS?^ 3i*nT V x-rJ' ^ t> fc t^jmSSr^T 3 
(Xx-yrS6) . ^i5*>. fifiia52 4fc:J3V^T. fg 

y 5 OtC«^aiil-rv^S7^-^fifc 
feil^I5IKH4{cJtLT{i. a^HfilltU*« 
Sifc^SidtfeSSii^rM y (rR. rG. rB) 
■tS. Ji«l3J24<i, ^5^2 6t*JLT«. » 
«B«^-5-<0**^^3 0 2 tai:*J-rs J: dfc%J»im 

[00491 iJCtC. mm2A\i. CCD;*^7lOT 

RGB^-?-fciaftLy;:Si (Xr-yT-S 10), felB^ 
I5I»14(c:J:i)RGB<i^S:»Jg^t-f-Y, felHi#R- 
Y, B-YfciaftL (;i.T-yrS12) , tttiS5!Hlil» 

[00501 'Wm 3 23&f , H^'J^aS' 

ffa (X7"-yrsi4) . ^ffi^-YVi'ssmfmm 

[00511 t-f. I^JBfSP 32 {±. IC;^-H15 1*J 

1 Cij-y^mXU 1 0 3fc:|ILa*ixTV^I.*»^¥'J^ 
S (x-r yrsi40 2) . 

[00521 \ci)-Y\3\im\MAta: 
v^ixtf . ¥!lIBia53 2tt. RAM^5 0 btfDWBra^ra 
(jiOat- K^sj^OiSSJ 1 4 7 ) co-f- 



(8) :^m^l0-35320 

14 

^<rm^^W<.h (XT-y7*S14 04) . RAM^iS 

2«. ICXr-b*ifAP10 3t#A:$itTV^SIC;<? 
-H 1 5 1 iOfim-rSffiS (WISrairn^^^AJ:S*T 
-^') 5:. RAM^5 0b<OIC;<?-Kx-^'BX'5a 
;^^^«|14 6t. ICX?-hm]R0SH5 82::n-L-C:J^ 
'^yn-H-rS (XT«y7-S14 08) . 
[00531 if^yxi- Yifm^zm-^h t . RAM 

10 tc I C;&- HiOiEe^li<^)5tiHI«l K^feli^ 
15 11) tc»#ii*ixTV>ST-^' («®^-K*T 
-9) WBiSfrn^^5A<7)|ltTS:ROM« 
JS5 0a*»<i,RAM^«5 0bA^Ur (XT-y^S 
1414) , «®i&Xfr.yri4 16fc:Jli6S, 
[0 0 541 XT' «y 7*3 14 08KiJV^Tr'>yo-H 
*«iE^tc*ITL=5r*>-5:tfc§K{i, ¥1111953 2«, RA 

im$!m%(r>m. (^^-Ymm&\ 4 7 ) 

WHbLT^' 'JT«®i: LT (XT«yrS 1 4 1 2 ) , Jft 
a* Xx >y r 1 4 1 6 titi^S . 
20 [0 0 5 51 ;^7^>yrS 1404 ttJl^T, RAMSiS 

g53 2{4, t-K«J'3Mi.X>f y^lOSS^-r^-K 

fc . RAM«j^5 0 b (rm^inm. raoii 

1^147) fc:##jitn-C>-^St-Ki:*^. -StLTV^ 
S*-^f-i-y^'-fS (XxyrS1418) , 
[00561 CICIT. ¥flffigS3 2«, Wt-KAJ-SL 
TV^ilK. ( j^T- yTS 1416) — 

ScL-CV^^rV^i:5W4. I C;i5-F 1 5 icort^ (¥«Bf 
^rn^^^i^fcS*:?'-^^') 5RAM®iS5 0b<30IC 
30 ;<?-Kx-^K»5j2^^14 6t:, ICXr-KSE»lX 
0IJ58^:rt-LT:r'5'>'O-H-tS (XT>yrsl40 
8) . 

[00571 t.fz. XT-yri4 0 2tCt5l»^TIC;<f- 
H 1 5 l*«IILji**iTV^^rV^C: fc*<«itB§nSi:. 
BigS3 2f4, RAM®li5Ob<O0fS<7)fi[i: (JIS^- 
KfH^flSlS 14 7) tCRO M^li 5 0 a<O0rS<Ofi[a 
(j!!SI*-K««Jil 4 2 ) tC»3'a*ilTV^ST-^' 

cD|ltT$:ROM^JS5 0a^tTL-C (XT-y7-S14 
40 06) , «iaS::;^T>yri416{Cjt«)&. 

[00581 XT-y7'14 16(CteV^T. fflBfg?32 
{4. ^:-H^'3ift;cX>f y^l 0 5<0Srrt-Ki:RA 

M^ii5 0 h<rm^(7im. (3!rat-F¥ijs?M«i 4 

7) t»l'ii**lTV^St-Ht*5-^LTt'>S*-^f- 
x.^y^-fh (Xx«yrS14 16) , ^UTV^^Jtil 
{f. 2J4. Slf^t-^'^yri 1 0Sr^$-^ 

(Xr-yrs 14 2 6). m^\zmiiM^Xhh^ 

S (XTyrS1428) . 
50 [00591 Xxyrsi4 16t:fcV^Tt-F*^ 
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L-ct^ntf , mi^3 2ii. mmm^^^ -vf - 1 1 

2W|Jt®5:^x>y^'-rS (X7^-yrs 1 4 2 0 ) . IXO 
#»^€X>f -yf-l 1 2*«3ryT-&itJf. flBrSS3 2 

L (Xr yTS 14 24). IXOf+J-mS^^ 

-Kfcf JROfttt^^t^ y^l 1 23&>':t7 

fc-ra (X-r yrsi4 22) . 
[00601 jyjifciJ: Ot- K¥iJS!B!ia (^^-r yr S 1 10 
4 ) ifim-^h fc . W8fa53 2tt. 3iS?;?iTJtt- K« 
iilMSrffo-tft {Xf-'/rs 16), Ht^, 5^5:8® 

~;^T'yTS 1 6«03?!a2:S'3ji-r. 

[ 0 0 6 1 1 ^ri>, i^fmmcmmmmmifmi^m 

^SPIt-Kttt, $Si2iSK!PI<offi 

owt^t-F, Jgflsos^-K. mmmkm. 

16) fcov^-ciiHfrs, 20 

[00 6 21 (4)#t-HO«ffl 



«8i2iit-b'^iis-r5fc«>t, fiiBfa53 2<i, x-y 

v=¥dlSia53 20 6i;. $MSlcaja53 2 0 8fc, 

gii32 12t, $M«SWBra53202t. mSWBr 

gK3 2 0 4 fc , a«v-y«i7'-^Ka^3 2 1 o t * 



[ 0 0 6 3 1 x y -JW^^S 2 0 6{i. aaj3!!H|5I»3 
6 J: 0 ai^>n:tx y i/^Sx-:}' <7)®a ( ±-h±Jfi 0 , 30 

^X-yi^T-^. -?-*U:iJ'KOX>yi^W-:J''C&?.*» 
t . mWd'hh , -e LT . S*$Mltf5x .y 

J^'T-^'2:^6IStaia53 2 0 St, ^iiSm<r):^-/ i^f 
-9 ( ffiTfrmx-y i^'T-:5' ) ^mm^m^-i 2 0 4 1 

[00641 mS»ajgS3 2 0 8Ji. x-y i/¥iJBf^3 2 
0 6 J: 0)*M$ftfc:Et*filx-/ i^'x-^' S: t» i: tSfi 

»ai-rs. 40 

[00651 mSift^3 2 1 2J1. SL«U->'4iT- 

9mhM3 2 1 0 i 0SZ'5a^t';<t 'J 5 Qoysmv- 

yi|iT-^5 00 2S:i,fcC. $«lScaja53 2 0 6*»^> 

W) i&«l£U MiSWBia53 2 04t:^<i^S, 
[00661 $M1»Ma53 2 0 2{i. :SK4jtlt-lry 

^<rmsmk^mi^m% 3204 tcMirr s . 
[00671 mmm&3 2 0 4-C-Ji, :^«i^a53 

212J:'?aifi3ixfc^«0igil$llT-^'T'a$«7)^ 50 



fTi^-y^&iSiiu, x.yv«sia53 20 6J:oafi3^t 
fefdSi^x .y i^^—^-mymmmmm^^y.. 

^^ilg5 2i&tft-LTjilE*t:SJarr*. Si^t:, 3»ig 
54^^LT^SrlHlj^S. 

[ 0 0 6 8 1 'J 5 Ott. mk^^^h^\zm^ 
hf-^^WtV-yWf-^ 5 0 0 2 i: LTEItr 

Sx-^' (Y. R-Y. B-Y) ?r$IfflT-^'5004 

^-^KSCffix-^ 5 0 0 6 fc LTIB^ 
5. a«U'-:^i|aT-:J')RjiaB3 2 1 Oti. 'J 5 0 
tfiHit^tutfflgV-Vilix-^ 5 0 0 2 JrBXOaty^ 

[00691 mz. miizx fymm^umt^imz-y 

fihtli) (XxyrS 1 602) , ClOiSMti, 

aai5oaiiiss3 6t:t3v^-c. amMflift'i'jit^ (m 

±(/M&.m) HScOfex-^' (Y. R-Y. B-Y) 

iJct. ttajf^^a53 835^. 

icr>T-i^ t2i^*J5 OffMnf—^"^ 5 0 04 1^*^) 
ffietTfcSmfe(^fflSt-ST-^ (Y, R-Y, B 
-Y) ^fflV^TttSJfe^x-^J'Sr^t^StV^dJSffi! 

Y («/h) < Y < Y {Wck) 
R-Y (fi/jN) < R-Y < R-Y (®^) 
B-Y iWt/h) < B-Y < B-Y (Wck) 

»J^fMc^i>ii:t:i^«>^LTi3<^) Siaif^ 

[00701 ftaij!iMES&3 6{±. mmm^tzn 

LT, iftajfe^St^^3 8iOMm2iTJtiftai^fefr 

0 ) OffigT'-^' (X .y i/ffiSr-:?' ) 5-x -y >''fllrgs 
3 20 6l;3*®rSj!Ba^tf9 (>^X"yrS160 

4 ) . -f^hiy. mmmm (ssv->') ^^mtfx-yi^' 

[00711 CliTcOJOBIS^SMlCilW-S . 08{CS^ 

^i^fc, -e<7)ttaisfi. (Y. R-Y. B- 

Y) ffirpiz. aait^frT-:J'(7)|gffltm^Sf&5:*^ 
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2rHigh r 1 J itimummilxM r 0 J t L/v:2fifl: 
T-^5:-^;tS#ffiT'fcS. mmr-iS'mxm roj 
ii>High r 1 J *|)V^J±High r i j ipi^iou r 0 j 

^itrhmmi:iy^y^t:i^mth (-t^hh. low 

roj *»^>High r 1 J >v<7)i:*>±Af5X>yyi:^ High 

r 1 J *>^Low r 0 J ^<oit>T**Ox>y i^'i&eiai-r 

[0072] mz. :si'y>msf^s 2 0 6«. minmk 

giitssaasrff a C^x-yr S l 6 O 6 > , 

[00 731 Z(0^(XTyrS16 06)Xii. 
JiIJ!SlI51»3 6 J: Oj*^>iTJtx .y i^ffiSr-^'co^faS- 
tfcttXx.yvx-^'jEp'W^^^tS. x-zi/^T- 

mtmrnx-m^^tix^^t, -sit. af&i^&iiiiaif^ 

^ 0 , :flr*.T*5 •? X .y iHi^^m^ •yi^b^i.ZtHi^ 

tl^^Ltz^. ^UJlJ'KOX.yS/t^MlX yvfc LT 

igilLTL^a. -E-i-C. BS+'C^lSiOfciOi:** 
±*f? X -/ j/$::t$six y 1 4 . ^<niLhTi^ 

OX y i/^:&$^X.y 5/7'-^' 1 6 fc ^^ttWi^X 

•y i^^Wj^ -y i^T-^ fc LTfJSftS . ^mi&m 
(i. BM+'t^llSSrfflv^TMaOtJt**. ^ici^St 
*i^m»<7)^t , HiaTa5+'C^^2 0 1 i^^y^ 

[0074] ULhfc i Ox v^T-^AJfUSiJSfiS t . 
x.yi;WBigit3 2 0 6{i, :te&$l&<Ox.y j^'t-^' 1 
4. 1 6S:*ia©ajg|53 2 0 8K. frfrmx.yi^'-f-^' 
S-^SfiJBtSa53 2 0 4 ^il-^tlMmth . 

[0075] iRfc:. mMmm 2 0 8*«. x.y vwgr 
353 2 0 6 J: ')M«Stl^t&«18x.y i^r-rJ' 1 4 , 
1 6i:i>bizmmm^\'\ #$iSx-/i;T-:?fc: 
*«-S1ISSI®S2:»aj-rS (XT-yrsi6 08) . 

[ 0 0 7 6 ] iJiCtC. $fil«l^g|53 2 1 2*i. WS-V-y 
Wif—9mM3 2 1 0 J: 0]ROSX:^f;><^:'J 5 0^ 

su-y(iT-^50 02^ttt. msi^aiaJ3 20 
^«SL. immmm20A\imm- 

S (X7^-yTS1610) , 
[ 0 0 7 7 ] »:{Cfel^^t€3!ra ( y TS 1 6 1 

2)X'\i. mpl4t®-byf - ( ma-fey^. 7 y 



1 8 



^32 1 2t<l: mm^ixfiMf^WMmb. x-y 
'JmU3 2 0 6 J: D3a©§<TJtBir:^*X.y i^T^-rJ'tT) 

I.. icOXT«yrS 1 6 1 2tt3V^T. iS^i]S*»'0r£<7) 

10 -r. 

[0 078] mgflRa53 2 0 4«. it^Six^i^ 
mzmtX. l^JPISrff 3 {Xx«yTS 16 14). 

ic^^jiftatcisv^T, mmmM3 20 A\t. «^ 

2^SISIgat-^'5 yT4 O^i&fflV^T e*<0)HE# 

<Li^*). mmz)!^ tf^j^ibiutrt^^ >y -fe-i^' 

HS-frSdi:**-?^*. ic7)Xx-yrsi6 14t:t>v^ 
5:, SMttS-fc>-9-5 6t3J:t^mS^»JBra53 2 0 2 

^tn-LTeitfi-rsfc. m^isfa53 2 0 4«. jpi^ 
smT-^'Sxoa^jiia (xxyrs8) tM-r. 

[0079] jH6^Ja«^gf^5r0r^i^rt ttf i>3: 
fel^¥'iBfS»3 2 04»4, aiS^fifc^U^t 
KtT, miHliS5!ra*ffv^ (XT^ yrs 16 16). 
sm-r-^'KOa^J&a (;^7^ yrs8) lizmt. z.<r> 
mmwmiz^\^x. mi^mu-i2QA\i. ^ 

30 iW^-arS (mtf. $!l»$-*-{tS) ^ttciO. fel^ 

[0 080] b. mkvmsmm.mmM'^-y^ 

m.iii.xfmxzts:h i a \zm-mwmfh^- yx 
[0081] ^^^sm<r>mmiWi^=^- K5- jei 
40 mmrm^m'tw^^-Y^%m-i>t:.mz. fjBras 

32«. x-y>'T!!lBfg|53 2 0 6i:, <S»a5a53208 

t . $iti«i£a53 2 1 2 1 . a«u-y<ix-^'ma5 
3 2 1 ofc. wmi^^mmim 2 1 4 . fii 

[ 0 0 8 2 ] X-y imms 2 0 6{i. tttti5!Sli]SS3 
6 J: Oj*^>ix^x -/ i;jS#x-^«0^ (i-feJii&s 0 . 
4^T*f3. J^ffiS^) :t$iSx.yi;T-^. :& 

$SX y>''7'-^'. 'etlJa51^X.y>''^T-^'T'S>-&i&^ 

WL. MWhmkX'hh. -eLT. t*^<OX-y 
50 i^'r-^' ^^mmiU 3 2 0 8 1 . ^mm<r>aL -/ 
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-9 ( fflttr^ y ) ^m:^m^3 2 o 4 1 

[0 0 83]$iSl©ifi3S3 2 08{±. X y S^iajBraS 3 2 
0 6 i OiSm^ix/itt^^Mlx y i^'T-^ S- *> h 

[0084] «illitSa53 2 1 2I±, a^u-yiiT- 

^'Kii^s 2 1 0 J: '3lX'3a^3t'^^ y 5 oioasu- 

:^1ST-^'500 2S-t>i:t:. <GS^a5g|53 2 0 8*»<5, 
iS«:$<t<:1i«»S<04»*>'5>^ilt-^§**m«(^ 10 
m.) ^JttSL. ^Sai^ffifig^iJlSrgSS 2 1 4 tiH 

[0085] «i||^li^fia¥'J|Bfa53 2 1 4-Cti. :S 
]^t^g|53 2 1 2 i Ojllfi$*T^S*<OigiliQSfc Sft 

[ 0 0 8 6 ] U 5 0{±. «Si&li£-rSJ©^t:fflV^ 

tit, :*^fi*S0ffll^-5T-5'fc, iiSSfetfflSi- 
hir~9 (Y. R-Y. B-Y) ^mmf-9 50 04 

Lt-r-^' Sr^WtcSffiT-^ 5 0 0 6 i: LTEItt 
S. SSl'->'i|ix-^'Kag?3 2 1 Oti:. 5 0 

tea* 3it3ta«i'-y(ix-^ 5 o o 2 5-k oatr* 

[0087] iKt. ««i2iKl!H!<7)JRi3#t-J^t-H 

^2r«t£^Si!5a*^fft)^i.i U'r-y-rs 16 0 30 
2) . ::(0«sui, i-f, affiJ!raiiI83 6{:t5v>T, 
a«H«'f iO^^ (iiiiH±<oii?&fil[S) B«<ofeT- 
^ (Y, R-Y. B-Y) ifi^yroy^^ti. 

m\i^m^S8i}t. ^ffiT—^t. ^t'JSOco^J 
ffllT-^'aJS 0 0 4tc^«>E«LTfc4ii85fefc:ffiS-r 
Sr-^' (Y. R-Y. B-Y) tS-fflV^Tttaife^ 

Y (fk/h) < Y < Y (m^) 

R-Y (g/h) <R-Y<R-Y (ft*) 40 

B-Y (ft/jN) <B-Y<B-Y (ft±) 

a. nS^iZ'^h^X'fib^LXiiKm tttiJl^ 
[0088] «iaj3!!®li]IS3 6{i. Ji«B«tit 

LT, «!aj^sii^38j:')i*m$fi^caaif^ftT so 



H^fcitrSft*J {S:-^Ji*Ji3 ) t&m {±ibTm) 
<r)mrf-9 (x./vffigr-rJ') SrttaitT ("t^:*) 

(S^l^-V) ^fi^tfX.yi/^^«l{i5L 
X) , x-/i;^^3 2 0 6fcjll^S (Xx yTSl 
604) . 

[ 0 0 8 9 ] x .y i^JffiMx-^'iOiiai^Sftfcx iz-^d 
Bra53 2 0 6{i. ttai«iaill?&3 6iOji'^*l^X-yi; 
J^T-:? tc^t LT . :£$«x -y i^'r-r? . y 

(XTyrS1606) . 

[0090] CKOSMI (Xr^yTS 1606) TJi, 

hbiiZLX^iyVT—^^'m.L. t*«iMl<OX .yi;T 
-^^81 4. 816i&*li»aia53 2 0 8{CiMfI^I.. 

i:, #x»/x<0ffi^ffi«t1iBg3nTV^I,. HRfi^ 

-y i^'issmax-/ i^'fc ^: ») , i*>T*« Ox y ~J1fi^^ 

tzBm&xf^^mifi^Ltim^. sismkox-y 

i^'fcSSlXyi^fcUT^tTLtd. -eiT-08tc* 
•tJ: a tHM*'t^8 1 8J:*}tEcr>iL*>±jfi*)x.yi^i: 
:£^x ^ s^'r-^ 8 14, ^co±hTi)^ •) x y 
^x y i^'x-:? 8 1 6 ^*im<OX -y i^'SrltLfir 
^•yv-'x-rJ't LXmUh, 

[ 0 0 9 1 ] x.y i^^—}f<nmii:^itf^mmM.tiim 

2 0 8{±. Xyi;^li|53 20 6J:'5^3*utftt$ 
«lxyi;^x-:J'8 14. 8162rfefct:B3ltt¥!lBrSrtf 
v\ #*«x-yj;r-^'fc:*frsi^ffl»«l3:»aj-fl. 
(Xxyrsi6 08) . 

[ 0 0 9 2 ] »c{c, ««st^3 2 1 2«. 

liT^-^'KaatS 2 1 0 J: '3K'93i^^'^^ *J 5 o<m 
SW-y|@T-^'5 0 02-&t,tC. S^aia5320 

(^gi»s) ^itst. ^eswisisi{3 2 i4fcsyi 
-rs (xf--yrsi6io) , 

[0093] ^fia¥'Jlllf^3 2 1 4{±, 15^ 

<^««it^ia53 2 1 2 1 J; fy^^^iXfOE^^bmSi 

^^^»-^^«tSi-|.^fiB«I^J!!yi (Xx>yrs 1 
622) iffo. 

[0094] $^>t:. ^fiiSfllSTgP3 2 14Ji, 

w^^&mmms 2 1 Ax-m^^tvtzwt^^^^iz 
intx. ^fs^a5 2*>^>^is, mi^^ta-tmm 

m<7im^iz^^^\,Mfimi^tii. 
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[0095] c. JgBE01^^:-H 

ti. «fiffi3JlBrSi53 2 16fc. gflllra53 2 18i:. 
M*t®fllBra53 2 0 2 . ^BSflBrSS 3 2 2 0 i: Srfii 

[0096] m&m^mu3 2 1 ea, ttiiiS!®iHi»3 
x'h&a^mL. MWhrnm-hi. -ett:. sis* 

<^Hco«iajffigT-^5 SfllBr?a53 2 1 8 ttttU^ft^ 
^ 3 8 fc WS&mm^ 3 2 2 0 1 s . 

[0097] mmu3 2 1 8{4. mmmim 2 1 
ms&«SL. :iSi^jiBfa53 220 izm^h . 

[00 98] mM«fflWKa53 2 0 2{l. :^«l[-fey 
1^ 5 6 *><i><Oli-^tc J: O , i»Wco^4Jt<S?:WISf 
-e^Bf|g«^^SS¥4»lia5 3 2 2 0 tism^?. . 

[0099] ^s^mu3 2 2 oTii. m&wmm^ 

321 eiOiS^tSn^iBlT-rJ'Taot&^^^L, 

BWisra53 2 1 8i*)mm^ix/::E(^mmvmM<Dm 

§ $W«<M3JBia5 3 2 0 2 J; O^^ti/trx 

[ 0 1 0 0 ] ^t y 5 0J4. ^SSSrSI^SJ^tffl 
V^I.t-:J'S:«I£t-:5' 5 0 0 8 1 L-Ci^if>fEeLTtJ 

ffis-rsr-^ (Y. R-Y. B-Y) ^wm-^s 

0 04tLTi^«>EeLTt5<, iifc. #|HISS-C»ai& 
r/Ji£ttT-:5'?:-HBNi<Jfc:»{KT-^' 5 0 0 6 fc LT 

[01011 mty)mwmr^m^^m 1 5 
h (xx-/rs 16 0 2). r««uui. t.-f. isai«i 

a. mmm.) Hs^ofer-^ (y. r-y, b-y) 

<OT-^t;^tU 5 0<0S(IffllT-:J'SP5 0 04t:^«>£ 
eLTJ>Sffli:M*iOfetCffla^Sx-:5' (Y. R- 

Y. B-Y) ■kWi\^xw!>^s^f-'9im:thm. 

Y (fflft/h) < Y < Y (fflfcfe) 
R-Y («ft/jN) <R-Y<R-Y (MBck) 
B-Y (ffiS/h) <B-Y<B-Y (fflfe*:) 

Y mmS^h) < Y < Y (SB^fc*:) 
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R-Y mmc/h) <R-Y<R-Y iW^Wck) 

B-Y mmi/h) <B-Y<B-Y (agft^) 
xuthip. i^-h^mn^ir^xiitf^^^^ioiz 

9 1 ftbm& LTfcv^:tT-i? $• t fc fctttilf^T^- 

10 . »S^fc-&*>-a:T^a6^ UTfc < ^) iSiaife 
^T-^ i&^i^* ^ fc i>-iiimxhh . 

[0102] <Xfc. aaiffiaiiII83 6J4. M«M«fcit 

LT . asi^sit^ 3 8 J: 9 

m%\zm-hm^ (4^±*«o > fcfi^ (±^t*«o ) 

(r>^=f-9 (x-/v'JlgT-^' ) S:af<JI8fa53 2 1 8 
fcafrrsJMtSrffd (;^T«yrS16 04) . 

fc. aiaii!!iBiigss3 6ji. aajf&^r-^'fcffls-ts 

HSiOmil 0 fc«UTS«Hffl±fctJ»tS^0ftJg<O 
20 fi[Bfc:*:ti§ (aaiMmT^-^) 2:««>. fflfiBUBiat 

3 2 1 4fc^i<ii-ssaa^ff a (x-r-yrs 1 6 3 

2) , 

[01031 T-^S:SfiL^Mfig¥dlBfa53 2 1 6 
Kia5«SlllS&3 6 J: OiS«$n:t1ga<0«iajffiMT 

:J'5:BWBfa53 218, ttaj^«ilSgi53 8 , ItBSffl 

BrSi53 2 2 ofc-5-ix-f*u*rrr-& (x-f»/rs 1 6 3 

4) . 

[01041 ^—9<nwm:mtiwm^32 1 8 

30 (4. SlfiSWISriai3 2 1 6 J: OiSS^nyiifiaT-^' J: 
"9 . aaj«iSll2lS&3 6 *><i,<O«B:<0x.y V'&Wf-^ti^ 

ii>a<^afciies-«SL. BcoBiKS:SisS¥'jista!3 

2 2 0fcjli^l. (Xr-yrSl 6 36) . 
[ 0 1 0 5 1 <5Cfc. WI^WS^%3 2 2 0J4. ffifiWaj 
Bfa!3 2 1 6 J: OiS^S^L/iaK^f^sHaJcOfiaT-^' 
iO. fflgl5<?Dil#?rSiit. ^^.fc. S¥iIBTSa53218 
J:0i*M$*L:tBcoiaSfcfcJ:'9. aMcomSSrit 

(Xx-/rsi 638) . 
[ 0 1 0 6 ] Xx-yT 1 6 3 SfcfcV^Tft^^tUt:^ 
40 JS)&SK/f^<^fiJ: Ofiv^J©^. mSS¥'JISfai3 2 2 0{4. 

TISS^S^) ^:frtTiH£«^^S-fr (Xx-yTS 
16 4 0). W^<nwmimW&< ^£->tL%^\z 
{4. ^SSfciiStT. «P?«S$!lfflliSS54 mUt. 

^§^S5 2 LTaas^fci*®^ fc s J; d^ftrrs 

(XT'yrsi64 0) . 

[0107] d. JgllSOS«<^)JR'?#tt^t-K 
^Hgcot-Kfc LTgBEOl^cOJROW-JtSSt-Kfc 
50 oV^TiiHa-rS. i<0t-KJ4. JgflS01^t-H<7)^ 
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1010 8] jg«o WE- HT'«, m 1 6ti^-r i d 

/ 3eS«±# $ fc^rS J: ^ fc^^S i i: *«a*ti 
HffiW+3lW+iet^Hffi<7) 2/3 3 c^^ag 

»^ i d i'rxmiM<omfiz t^^rtttj $ * s i 3 

0 1 6 fcr^J: 0 izmVtmzm -?TV^SJ©^K 
;gv^#" e-" 017<Oj:dK:M 

[0109] JgBSOS«<7)ffi'9W»tS«t-KOl|3ScO 
fci^. fiIita53 2iOfil)S*Hl8t:*-r. gBEO^ 

M4aW!)fl»3 2 1 6 fc . gBE'98«]RftfiS19jKa53 

[0110] mmmmm 2 1 en. mtmm^^s 
Thta^ML. Mttthm^xt>&. -etx. mm 
m.nmmn 3222 tix^s . 

[0111] JgBR 08^#fi[K*'JSiaJ 322 2-C«, 

mmmm 2 1 e i oj^«$n:tiaT-:?-ca<E# 

[0112] 5 0{i. ^^^V^5r«^4J©^ 
tfflv^Sr-^' ^ ^-T-:? 5 0 1 0 1 L-Ci^V>E1iL 

fetffla-rST-:5' (Y. R-Y. B-Y) S-JOffilx- 
9 50 0 At LX=f»M'&LXii< , i/i. ^-EiS-C© 

aiat^ai£t/;7"-^'?:-fifW{^ni7'-:j' 5 0 0 6 1 
Lxumh. 

[0113] ort, JgHEOSffiWSXOftJt^t-K 

[ 0 1 1 4 ] 4-f . m^-th^^ii^^hmofi^ 
hix^ {x'f'/rs\eo2) . z<mw,i. t-r. m 

«ffl. a^S) BS«7)fex-^ (Y. R-Y. B- 

Y) ifi^yrvyi/^tL. ttai^ff^fc^3 8 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention picturizes the interna l and external 
environment of vehicles with image pck-up equipment, and relates to the image processing^s ystem for 
mount which performs various processing modes based on the image pck-up data. 
[0002] 

[Description of the Prior Art] The equipment which grasps the situation of vehicles inside and outside in 
conventionally analyzing the picture acquired from the image pck-up means is known. For example, as 
technology which supervises a vehicles operator, there is vehicles operator supervisory equipment 
indicated by JP,4-68500,A. Using the monochrome picture acquired from the image pck-up means, with 
the difference fractionation image of a background image and a vehicles operator picture, this equipment 
extracts the image data of an operator's face section, detects the direction of a face, and the state of an 
eye from the image data of this face section, and supervises the sense of a vehicles operator's face, and 
the state of an eye. Moreover, to JP,62-121599,A, the image data of an alarm lamp is extracted out of the 
image data ahead of [ of vehicles ] travelling direction, and the equipment which detects existence of a 
front vehicle or measures the distance between two cars is indicated. Moreover, the equipment which 
extracts a lane is indicated by JP,5-151341,A from the picture ahead of vehicles. 
[0003] 

[Problem(s) to be Solved by the Invention] With such conventional technology, the image data of the 
specified substance is extracted by recognizing the edge point that the brightness of a picture changes. 
However, in order to obtain sensitivity sufficient in a gloomy situation like in the car [ of night ] brightly 
[ in order for change of brightness to extract image data / the candidate for an image pck-up ], the image 
pck-up equipment of expensive high sensitivity had to be used. 

[0004] Then, it aims at offering the image processing system for mount using the vehicles situation- 
recognition method sufficient also in a gloomy situation that sensitivity is obtained, and this method in 
this invention. 
[0005] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, in this invention, the 
outside of the vehicle ind oor sectio n of vehicles 0 £-a vff^hirlei .s picturize d, image pck-up data are 
acquire?, and the vehiclessituation-recognition method of extracting the image data of the object 
beforehand defined based on the difference of the hue of each pixel in these image pck-up data, and the 
storage holding the program which performs this method are offered. 

[0006] Moreover, in this invention, the image processing system with which it has the image pck-up 
equipment which ^ toiurizes the outside of the vehicle indoor section of vehicles or a vehicle, and 
acquires image pck-up data as an image pro cessing system for mount using the above-mentioned 
vehicles situation-recognition method, ana"tne control unit which processes these image pck-up data, 
and a control unit is equipped with an extraction means extract the image data of the object beforehand 
defined based on the difference of the hue of each pixel in image pck-up data is offered. 
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[0007] 

[Embodiments of the Invention] According to the vehicles situation-recognition method of this 
invention, it can recognize about vehicle indoor (the inside of a cargo compartment is included) various 
situations^ Moreover, according to the image processing system for mount of this invention, color 
picture image pck-up equipment with easy attachment can perform various processings using the image- 
recognition result. 

[0008] For example, an object can be used as either [ at least ] the face of the ope ratQL pf the above - 
mentioned vehicles, or an eye, a nd it can presume w hether an operator is dozing or not based on th e 
extracted image data. Moreover, an object is made^'into at least the crew of the above-mentioned vehicle 
interior ot a room, and one side of a cargo, and the position of an object may be presumed based on the 
extracted image data, and you may ask for load balance based on a presumed result. Furthermore, it 
expands or reduces and you may make it display the picture of the face from which it considered as the 
one face at least, and the object was extracted based on the extracted image data of the crew of the 
vehicle interior of a room on the position of the display screen so that the viewing area may become a 
predetermined size. 

[0009] Furthermore, a processing-mode selection means to receive selection of the processing mode 
from thejDu tside in this invention . It has the image pck-up equipment which picturizes the outside of the 
vehiclelndoor seTition'or vehicles, or a vehicle, and acquires image pck-up data, and the control unit 
which processes based on image pck-up data, a control unit An extraction means to extract the image 
data of the object defined according to the processing mode which received selection from image pck-up 
data, The image processing system for mount equipped with a processing-mode execution means to 
perform processing defined according to the processing mode which received selection is offered using 
the extracted image data. 

[0010] If it does in this way and a processing mode will be chosen by the processing-mode selection 
means, the specific objects (sight an operator's face section, crew's taking-a-seat situation, specific 
crew's style, and ahead of vehicles etc.) according to the control purpose will be extracted by the specific 
object extraction means, and the processing mode chosen based on the extraction data will be 
performed. Therefore, sinre 4we"e^4ftQre processing mod eswit h one image processing system can b e 
p erformed, a compact and cheap image processing system is offerM . 

fOOl 1] there are for example, nap ajari nmode, balan i£jdetectiQ n mode, mir ror mode, front recognition 
piada, etc. in a processing mode, and in the image processing system which performs two more than of 
the modes of these, a processing-mode selection means receives the input of selection directions from 
the outside, and notifies the selected mode to a processing-mode execution means. In addition, for 
example, a control panel equipped with a mode transfer switch may be formed, and the input of 
selection directions may be received with this switch. 

[0012] Moreover, according to the lens scale factor of image pck-up equipment, you may choose a 
processing mode. What is necessary is to establish the scale-factor switch means which switches a lens 
scale factor to image pck-up equipment when doing in this way, and a means to notify the information 
which shows a lens scale factor when a lens scale factor is switched to a processing-mode selection 
means, and just to establish a means to choose a processing mode, according to this information, if the 
information which shows a lens scale factor at a processing-mode selection means is notified. 
[0013] Moreover, according to the reading resuh of storages (IC (integrated circuit) card etc.), you may 
choose a processing mode. For example, a storage reader is formed, and if the storage holding the 
program which performs one of processing modes is read with this storage reader, an extraction means 
and a processing-mode execution means should be made for a processing-mode selection means to 
choose a processing mode according to the read information, and just to perform the program read by 
the storage reader, respectively. 

[0014] What is necessary is to establish a means receive selection in nap alarm mode for a processing- 
mode selection means in order to correspond to each above-mentioned processing mode, a means 
receive selection in balance detection mode, a means receive selection in mirror mode, a means receive 
selection in front recognition mode, etc., and just to prepare a means perform the processing which was 
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chosen at the processing-mode execution means and which was beforehand defined for every processing 
mode. 

[0015] If selection in alarm mode is received for an extraction means in order to realize nap alarm mode 
If a means to extract one [ at least ] image data of the faces and eyes of the operator of vehicles is 
established based on a difference of the hue of each pixel in image pck-up data and selection in alarm 
mode is received for a processing-mode execution means What is necessary is just to establish a nap 
presumption means to presume whether the above-mentioned operator is dozing, based on the image 
data by which extraction was carried out [ above-mentioned ]. In addition, it is desirable to equip a 
processing-mode execution means with either [ at least ] an alarm means or the risk-aversion meanses in 
this case. Here, an alarm means is a means which will emit an alarm if it is presumed by the nap 
presumption means that the above-mentioned operator is dozing, and risk-aversion meanses are meanses 
(for example, it is made to operate [ to which the control characteristic of vehicles kinematic-control 
equipment is changed ] automatically, or vehicles are stopped) to change a rolling-stock-run state, when 
it is presumed that the above-mentioned operator is dozing by the nap presumption means. 
[0016] What is necessary is just to prepare a load balance detection means ask load balance, based on 
the extracted image data, if a means will extract one [ the crew of the vehicle interior of a room and / at 
least ] image data of a cargo based on a difference of the hue of each pixel in image pck-up data if 
selection in balance detection mode is received for an extraction means is established and selection in 
balance detection mode is received to a processing-mode execution means, in order to realize balance 
detection mode. In addition, it is desirable to have further a means by which a processing-mode 
execution means changes the control characteristic of vehicles kinematic-control equipment in this case 
according to a detection result. 

[0017] If selection in mirror mode is received for an extraction means in order to realize mirror mode If 
a means of the crew of the above-mentioned vehicle interior of a room to extract the image data of a one 
face at least is established based on a difference of the hue of each pixel in the above-mentioned image 
pck-up data and selection in mirror mode is received on it at a processing-mode execution means What 
is necessary is to expand or reduce the picture of the face extracted based on the extracted image data so 
that it may become a predetermined size, and just to establish a crew image display means to display on 
the position of the display screen of display. In addition, the image processing system of this invention 
equipped with the realization means in this mirror mode can also be used as image display equipment of 
a TV phone. 

[001 8] If selection in front recognition mode is received for an extraction means in order to realize front 
recognition mode a basis [ difference / the hue of each pixel in image pck-up data ] - the object ahead 
of / image pck-up data to / travelling direction (a lane --) If a means to extract the image data of a signal, 
an indicator, and/or front vehicles is established and selection in front recognition mode is received for a 
processing-mode execution means What is necessary is just to establish a danger presumption means to 
presume danger, from the relative location of an object and self- vehicles based on the extracted image 
data. In this case, a processing-mode execution means has the desirable thing of an alarm means to 
perform alarm processing according to the presumed danger, and the risk-aversion means which takes 
risk-aversion disposal according to the presumed danger for which it has either further at least, there are 
disposal (for example, the control characteristic of vehicles kinematic-control equipment is changed - it 
is made to operate automatically or vehicles are stopped) to which for example, a self-rolling-stock-run 
state is changed, disposal (for example, an air-conditioner is operated, the temperature of the vehicle 
interior of a room is lowered, or a wind direction is changed so that a wind may be equivalent to an 
operator's face) to which a vehicles state (environment of especially the vehicle interior of a room) is 
changed as risk-aversion disposal 

[0019] In addition, if the light which carried out incidence of the room mirror of vehicles from the 
reverse side penetrates, the light which carried out incidence from the table considers as the one-way 
mirror to reflect and the display screen is installed in the reverse side of this one-way mirror, since the 
space where in the car was restricted can be used effectively, it is desirable. If it does in this way, an 
operator or a fellow passenger can check by looking the scene of the back projected on this one-way 
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mirror, when a one-way mirror can be spaced, this picture can be checked by looking, when the picture 

is displayed on the display screen, and the picture is not displayed on the display screen. 

[0020] Although the storage holding the program for realizing each processing mode is offered in this 

invention, as long as the information which can be read is held as this storage by information processors, 

such as an IC card, a magnetic tape, a magnetic disk, a floppy disk, an optical disk, and a ROM (Read 

Only Memory) card, for example, the thing of what form may be used. 

[0021] 

[Example] Hereafter, detailed explanation of the example of this invention is given using a drawing. In 
addition, although the image processing system for mount of this example is carried in the vehicle 
interior of a room of an automobile, this invention is not restricted to this, for example, may carry in a 
cargo compartment etc. Moreover, it can also use for a train, a vessel, an airplane, etc. 
[0022] (1) The appearance of the image processing system of this example is shown in the hardware 
block diagram 1(1). The image processing system of this example is equipped with a main part 117, the 
image pck-up system 106, an electrical power system 104, and fixed mechanism 102a, and is equipped 
with the drop 302 further shown in drawing 3 . 

[0023] Fixed mechanism 102a consists of a universal joint 102 prepared in the upper part of a main part 
117, and an attachment 101 connected to the universal joint 102 possible [ the angle change to front and 
rear, right and left ]. An attachment 101 is a mechanism for fixing this image processing system to sun- 
visor 1 1 1 grade, for example, can use a thing like a clip as this attachment 101. When using a clip, this 
image processing system can be fixed by pinching the sun-visor 1 1 1 grade of vehicles by this 
attachment 101. T herebv. this equipment can change an angle all around, an d can attach a main part 1 1 7 
in various places, and can picturize easily bo th outside in the car and a vehicl e. The power supply of this 
image processing system is supplied by the cig^-lighter socket 1U4. In addition, the supply from a solar 
battery is sufficient as a power supply, and further, if it has the battery of a charge formula, it can save 
the time and effort of wiring and can enable use in the outdoors. 

[0024] In addition, although it is united as the image pck-up system 106 and a main part 1 17 show 
drawin g 1 (1), as shown in drawin g 2 , you may make the image processing system of this example 
separate. In the image processing system shown in drawing 2 , as shown in drawing 2 (1), the universal 
joint 102 is attached in the upper part of the image pck-up system 106, and the image pck-up system 106 
is fixed by the attachment 101 linked to this universal joint 102. For example, if a thing like a sucker is 
used for an attachment 101, the image pck-up system 106 is fixable to aperture 116 grade. The image 
pck-up system 106 is equipped with transceiver section 120a and electric power switch 108a, and the 
transceiver section 120 and the transceiver section 120 of a main part 107 are connected by the cable or 
radio. If it does in this way, since an angle can be changed all around and the image pck-up system 106 
can be attached in various places, both outside in the car and a vehicle can be supervised easily. 
[0025] The main part 1 17 of equipment of this example equips the interior with an information 
processor (it has arithmetic and program control (not shovsm) and memory 50 (it illustrates to drawin g 
4 )). Moreover, as shown in the main part 1 17 of equipment at drawing 1 (2), the IC card insertion 
mouth 103, the mode transfer switch 105, the zoom manufacture switch 107, an electric power switch 
108, the power supply monitor lamp 109, the monitor lamp 1 10 of operation, the attachment 
configuration switch 1 12, a loudspeaker 1 13, the drop output section 1 14, and the processing result 
monitor lamp 1 1 5 are formed. 

[0026] The IC card insertion mouth 103 is equipped with the IC card reading section 58 (it illustrates to 
drawin g 4 ) which notifies the information read in the IC card to the information processor of a main 
part 1 17. In the image processing system of this example, by substituting the IC card (the program 
which realizes various kinds of functions being held) inserted in the IC card insertion mouth 103, the 
program to perform can be changed and the function to realize can be chosen. Moreover, it processes 
with the mode changeover switch 105 by changing various kinds of functions currently written in the 
memory of built-in on the main part of equipment. 

[0027] The image pck-up system 106 is color picture correspondence, and it is made to adjust a scale 
factor and drawing to various kinds of functions, respectively. Moreover, it can be arbitrarily set as the 
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scale factor which an operator demands with the zoom adjustment switch 107. 
[0028] The example of a drop 302 is shown in drawing 3 . The drop 302 of this example is the Hquid 
crystal display monitor of a super-thin shape, and is built in the sun visor 1 1 1 which is in the passenger 
seat or driver's seat of vehicles with a mirror 304. In addition, you may use the monitor of navigation 
equipment, and mounted television and other picture output units as a drop 302. Although the cable 
connects, you may cormect a drop 302 and the drop output section 1 14 by radio through radio- 
transmission equipment. If it does in this way, an installation can be chosen freely, for example, such as 
installing a drop 302 for a main part 1 17 outside a vehicle in the car. 

[0029] In this example, although the display screen of a drop 302 was installed in the sun visor, the light 
which carried out incidence of the room mirror from the reverse side penetrates, and the light which 
carried out incidence from the table may consider as the one-way mirror to reflect, and may install the 
display screen of a drop 302 in the rear face of this one-way mirror. If it does in this way, since the scene 
of the back projected on this one-way mirror can be checked by looking when a one-way mirror can be 
spaced, this picture can be checked by looking, when the picture is displayed on the display screen, and 
the picture is not displayed on the display screen, an operator or a fellow passenger can use effectively 
the space where in the car was restricted. Similarly, the mirror 304 of a sun visor 1 1 1 may be used as a 
one-way mirror, and the display screen of a drop 302 may be prepared in this reverse side. 
[0030] (2) The system configuration of the image processing system of a system configuration this 
example is shown in drawing 4 . The image processing system of this example is equipped with the 
image pck-up section 24, a display 26, and the processing section 28. 

[0031] The image pck-up section 24 is equipped with the zoom mechanism section 2, the zoom 
controller 4, the iris mechanism section 6, the iris controller 8, the CCD (charge-coupled device) camera 
10, A/D converter 12, and the color difference conversion circuit 14. The zoom mechanism section 2 
and the zoom controller 4 change the scale factor of an image pck-up picture. The iris mechanism 
section 6 and the iris controller 8 make a photographic subject's luminosity a proper value by closing 
drawing, when an image pck-up picture including the photographic subject is too bright, and opening 
drawing, when an image pck-up picture including the photographic subject is too dark. Furthermore, 
adjustment of a focus is also performed. CCD camera 10 is an example of an image pck-up means, and 
changes a photographic subject's picture into a color analog signal. A/D converter 12 changes into a 
digital signal the analog picture signal outputted from CCD camera 10. The color difference conversion 
circuit 14 is a circuit which changes into a luminance signal Y and the image pck-up picture signal of a 
color-difference signal (R-Y, B-Y) the three-primary-colors (R (red), G (green), B (blue)) signal of the 
photographic subject which received as a digital signal. An image pck-up picture signal (Y, R-Y, B-Y) 
is defined as follows using an RGB code. 

[0032] R - ' - R-gamma RG' = G-gammaGB' - = B-gamma BY = 0.3R'+0.6G - '+0.1 B'R-Y = 0.7R'- 
0.6G' -0.1 B'B-Y =-0.3R'-0.6G -- '+0.9B' - here, color emphasis gain (gammaR, gammaG, gammaB) is 
a value determined by the extraction condition determination section 38 Usually, since (1, 1, 1) are 
specified, as for color emphasis gain, the color of an image pck-up picture is outputted as it is. 
Moreover, since a bigger value than 1 is specified when dark in twilight etc., an image pck-up picture is 
outputted more brightly. 

[0033] A display 26 is equipped with a delay circuit 16, the substitution circuit 18, the encoder circuit 
20, and the drop output section 1 14. A delay circuit 16 is a circuit with which a picture output is delayed 
and the synchronization with a processing result and an image pck-up picture is doubled, while 
performing various processings in the processing section 28. The substitution circuit 18 is a circuit 
which piles up the processing resuh from the processing section 28 to an image pck-up picture. The 
encoder circuit 20 receives the processing picture signal processed in the substitution circuit 18, it is the 
circuit changed into an NTSC (National Television System Committee) signal, and an NTSC signal is 
outputted to the exterior of equipment through the drop output section 1 14. The drop 302 which received 
this NTSC signal through the circuit 301 displays a picture based on a signal. 

[0034] A drop 302 receives an NTSC signal and displays a processing picture. The drop output section 
1 14 is simply connected with a drop 302 with a cable. Moreover, you may connect with a drop 302 
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through radio-transmission equipment. If it does in this way, an installation can be chosen freely, for 
example, such as installing a drop 302 for a main part 117 outside a vehicle in the car. 
[0035] The processing section 28 is equipped with the image-processing section 30 and the judgment 
section 32. The image-processing section 30 is equipped with the extraction processing circuit 36 and 
the extraction condition determination section 38. 

[0036] The extraction processing circuit 36 is a circuit which has two functions greatly. One 
discriminates the pixel equivalent to the extraction color condition data (it explains later) transmitted 
from the extraction condition determination section 38 to an image pck-up picture. The coordinate data 
(edge coordinate data) of the beginning (standup) to the pixel on a level line and the last (falling) is 
transmitted to the substitution circuit 18 and the judgment section 32. Furthermore, it is the function to 
transmit the coordinate data (extraction coordinate data) of the circumscription square which a level line 
and vertical lines touch to the meeting of the pixel equivalent to extraction color conditions to the 
judgment section 32. Another is the function to sample the color data (Y, R-Y, B-Y) of a specific pixel, 
and to transmit the data to the extraction condition determination section 38 from the inside of an image 
pck-up picture. 

[0037] The extraction condition determination section 38 determines extraction color condition data 
based on the fundamental color data (Y, R-Y, B-Y) of the object which has been memorized in memory 
50 in accordance with each mode and to extract, and the color data (Y, R-Y, B-Y) sampled in the 
extraction processing circuit 36, and transmits to the extraction processing circuit 36. Furthermore, to 
the zoom controller 4 and the iris controller 8, an adjustment value is determined, it transmits based on 
the fundamental adjustment data memorized in memory 50 in accordance with each mode, and the color 
data (Y, R-Y, B-Y) sampled in the extraction processing circuit 36, and the color emphasis gain 
(gammaR, gammaG, gammaB) in the color difference conversion circuit 14 is modified. 
[0038] In addition, the extraction condition determination section 38 is realized by the information 
processor of the main part 1 17 of equipment. That is, when the arithmetic and program control of an 
information processor performs the program held at memory 50, the judgment section 32 is realized. 
[0039] If an object is people's face, let the fundamental color data of an object be the combination of 
black (color of the hair of hair), and flesh color. Moreover, when th e lane on a road (white, yellow) is 
used as an object, it considers as the white or yellow which is a color of a lane. Or it considers as gray as 
the road in front of a self-vehicle, i.e., a color of a road surface. In this case, a road is recognized first 
and it substitutes by making the circumference curve into a lane. Moreover, if an indicator, a signal, etc. 
are objects, let the combination of the color which shows them, i.e., blue, red, yellow, green, etc. be 
fundamental color data. Fundamental color data are memorized by memory 50 in accordance with each 
mode, and this color data is corrected as extraction color condition data in the extraction condition 
determination section 36. In this example, fundamental color data, fundamental adjustment data, etc. are 
changed according to substitution of the IC card to the IC card reading mouth 103, or the state of the 
mode changeover switch 105, and an object changes. 

[0040] The contents of the data which IC card 1 5 1 holds are shown in drawing 10 . IC card 1 5 1 is 
equipped with the processing-mode name field 1511 which has memorized processing-mode name data, 
the judgment section program field 1512 which has memorized the judgment section program 
corresponding to this processing mode, and the prime data area 1513 which has memorized the 
fundamental color data corresponding to this processing mode, fundamental adjustment data, etc. 
[0041] The contents of the data which memory 50 holds are shown in drawin g 9 . Memory 50 consists 
of ROM (READ ONLY MEMORY) field 50a and RAM (RANDOM ACCESS MEMORY) field 50b. 
ROM field 50a is equipped with the field 141 holding the basic program which controls this equipment, 
the field 142 holding a processing-mode name, the field 144 holding the judgment section program 
corresponding to the mode of built-in to this equipment, and the field 143 that holds fundamental color 
data corresponding to the mode, fundamental adjustment data, etc. of built-in to this equipment as 
master data. Moreover, RAM field 50b is equipped with the calculafion data storage area 145 for 
holding temporarily the data (calculation data 5006 (it illustrating to drawin g 6 )) computed or presumed 
in each circuit, the field 146 which incorporates the contents of IC card 151, and the processing-mode 
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distinction field 147 for distinction of a processing mode. The field 146 which incorporates the contents 
of IC card 151 has a judgment section program field and a prime data area. In addition, in accordance 
with a basic program and the master data corresponding to the selected mode, it is called control data 
5004 (it illustrates to drawing 6 ). 

[0042] In addition to an above-mentioned display 26 and an above-mentioned drop 302, the image 
processing system of this example is equipped with sound equipment (loudspeaker) y 3, the processing 
result monitor lamp 115, and the monitor lamp 1 10 of operation as an output means. These output 
meanses are meanses for reporting the result judged in the judgment section 32 to an operator. 
[0043] Furthermore, the image processing system of this example is equipped with vehicles kinematic- 
control equipment 54 and the vehicles state sensor 56. Vehicles kinematic-control equipment 54 is a 
control unit of a drive system, a braking system, and a steering system. The vehicles state sensor 56 is a 
means to detect the momentum of self-vehicles, an operator's operation will, etc., and transmits the 
detected signal to the judgment section 32. 

[0044] The judgment section 32 is realized by the information processor of the main part 1 17 of 
equipment. That is, when the arithmetic and program control of an information processor performs the 
program held at memory 50, the judgment section 32 is realized. 

[0045] In addition, in this example, the extraction condition determination section 38 and the judgment 
section 32 may realize a personal circuit etc. by other meanses, although software realizes. Similarly, in 
this example, when the arithmetic and program control of an information processor performs the 
program held at memory 50, you may realize the means (the color difference conversion circuit 14, the 
substitution circuit 18, an encoder circuit, extraction processing circuit 36) realized by the circuit. 
[0046] (3) the contents of processing - below, explain the flow of the processing in the image 
processing system of this example using drawin g 5 

[0047] If an electric power switch 108 is turned ON (Step S2), the judgment section 32 will perform 
troubleshooting first (Step S4). In this troubleshooting processing, the check of memory 50 and a 
diagnosis of the image pck-up section 24 are performed. That is, when read/write of memory 50 is not 
made or change of zoom or opening and closing of drawing cannot be performed, in failure mode 
processing (Step SI 8), the contents of failure are told in blink code of the monitor lamp 1 10 of 
operation, and troubleshooting is repeated. 

[0048] When there is no failure, the image pck-up section 24 performs initial setting based on the data 
currently vvritten in memory 50 (Step S6). That is, in the image pck-up section 24, it is set as the data 
value in which a scale factor, drawing, etc. are written by memory 50, and to the color difference 
conversion circuit 14, color emphasis gain (gammaR, gammaG, gammaB) is set up so that it may 
usually be in a picture output state. Moreover, to a display 26, initial setting of the image pck-up section 
24 is carried out so that an image pck-up picture may be outputted to a drop 302 as it is. 
[0049] Next, the image pck-up section 24 picturizes a photographic subject by CCD camera 10, changes 
a photographic subject's obtained optical video signal into an analog-RGB signal (Step S8), 
subsequently to a digital RGB code, after it changes an analog-RGB signal by AID converter 12 (Step 
SIO), changes an RGB code into a luminance signal Y, color-difference-signal R-Y, and B-Y by the 
color difference conversion circuit 14 (Step SI 2), and transmits to the extraction processing circuit 36. 
[0050] Next, the judgment section 32 performs mode judging processing (Step S14). Drawing 1 1 
explains the detail of this mode judging processing. 

[0051] First, the judgment section 32 judges whether IC card 151 is inserted in the IC card insertion 
mouth 103 (Step SI 402). 

[0052] Here, if IC card 151 is inserted, the judgment section 32 will investigate the existence of the data 
of the judgment section program field (it is in the processing-mode distinction field 147) of RAM field 
50b (Step SI 404). If there are no data of the judgment section program field of a RAM field, the 
judgment section 32 will download the information (a judgment section program and master data) which 
IC card 151 inserted in the IC card insertion mouth 103 holds through the IC card reading section 58 to 
the IC card data incorporation field 146 of RAM field 50b (Step SI 408). 

[0053] After download is completed normally, the data (processing-mode name data) currently written 
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in the head address (processing-mode name field 151 1) of the storage region of an IC card at the 
position (processing-mode distinction field 147) of RAM field 50b are copied, judgment section 
program execution is shifted to RAM field 50b from ROM field 50a (Step S1414), and processing is 
advanced to Step 1416. 

[0054] When download is not normally completed in Step S1408, the judgment section 32 initializes the 
position (processing-mode distinction field 147) of a RAM field, and advances (Step S1412) and 
processing to Step 1416 as a cleared condition. 

[0055] In Step SI 404, if there are data of the judgment section program field of RAM field 50b, it will 
be confirmed whether the judgment section 32 of the mode [ the mode shown mode transfer-switch 105 
and ] currently v^itten in the position (processing-mode distinction field 147) of RAM field 50b 
corresponds (Step S1418). 

[0056] Here, if both the modes of the judgment section 32 correspond, the next processing (Step SI 41 6) 
is performed, and when not in agreement, it will download the contents (a judgment section program 
and master data) of IC card 151 through the IC card reading section 58 to the IC card data incorporation 
field 146 of RAM field 50b (Step SI 408). 

[0057] Moreover, if it is detected that IC card 151 is not inserted in Step 1402, the judgment section 32 
will copy the data (processing-mode name data) currently written in the position (processing-mode 
distinction field 147) of RAM field 50b at the position (processing-mode name field 142) of ROM field 
50a, will shift judgment section program execution to ROM field 50a (Step SI 406), and will advance 
processing to Step 1416. 

[0058] In Step 1416, it is confirmed whether the mode which the mode transfer switch 105 shows, and 
the mode of the judgment section 32 currently written in the position (processing-mode distinction field 
147) of RAM field 50b correspond (Step S1416). If not in agreement, the judgment section 32 blinks the 
monitor lamp 1 10 of operation (Step SI 426), and after it reports that it cannot perform to an operator, it 
usually makes a direct statement picture output mode (Step SI 428). 

[0059] If the mode is in agreement in Step SI 41 6, the judgment secfion 32 will check the state of the 
installation configuration switch 1 12 (Step SI 420). If the judgment section 32 will make installation 
setting processing in the selected mode a direct statement if the installation configuration switch 1 12 is 
ON (Step SI 424), and the installation configuration switch 1 12 changes after that at OFF, let the 
selected mode be a direct statement. Moreover, if the installation configuration switch 1 12 is off, the 
judgment section 32 will make the selected mode a direct statement (Step SI 422). 
[0060] After mode distinction processing (Step SI 4) is completed by the above, after the judgment 
section 32 processes the selected mode (Step SI 6), again, it returns processing to image pck-up data 
taking-in processing (Step S8), and repeats processing of Step S8 - Step SI 6. 
[0061] In addition, there are lane recognition mode, the installation setting mode of lane recognition 
processing, nap alarm mode, installation setting mode of a nap alarm, load balance mode, and mirror 
mode in the processing mode which can perform the image processing system of this example. Below, 
processing (Step SI 6) in these modes is explained. 

[0062] (4) The composition for realizing processing a. lane recognition mode lane recognition mode in 
each mode is shown in drawing 6 . In order to realize lane recognition mode, the judgment section 32 is 
equipped with the edge judgment section 3206, the lane calculation section 3208, the lane presumption 
section 3212, the vehicles state judgment section 3202, the danger judgment secfion 3204, and the ideal 
rain width-of-face data taking-in section 3210. 

[0063] It is the circuit which the edge judgment section 3206 judges whether the kinds (starting falling, 
a coordinate position, etc.) of edge coordinate data sent from the extraction processing circuit 36 are left 
lane edge data, right lane edge data, and the other edge point data, and is classified. And the other edge 
data (forward vehicle edge data) are transmitted for the edge data of a right-and-left lane to the lane 
calculation secfion 3208 at the danger judgment section 3204. 

[0064] The lane calculation section 3208 makes a linearity judgment based on the right-and-left lane 
edge data transmitted from the edge judgment section 3206, and computes the candidate lane to each 
lane edge data. 
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[0065] The lane presumption section 3212 presumes the right-and-left lane (recognition lane) which 
should be recognized out of the candidate lane transmitted from the lane calculation section 3206 based 
on the ideal rain width-of-face data 5002 of memory 50 incorporated from the ideal rain width-of-face 
data taking-in section 3210, and transmits to the danger judgment section 3204. 

[0066] With the signal from the vehicles state sensor 56, the vehicles state judgment section 3202 judges 
a self-rolling-stock-run state, and transmits the judgment result to the danger judgment section 3204. 
[0067] In the danger judgment section 3204, the run lane of a self-vehicle is recognized by the 
recognition lane data of the right and left transmitted from the lane presumption section 3212, a forward 
vehicle, an obstruction, etc. are recognized by the forward vehicle edge data transmitted from the edge 
judgment section 3206, and the run state of a self-vehicle is recognized by the data transmitted from the 
vehicles state judgment section 3202, And in consideration of those three elements, danger is presumed 
from the relation between the run state of a self-vehicle, and the road surface which can be run. Here, 
when it is presumed that danger is high, it reports to an operator through sound equipment 52. 
Furthermore, when operation of an operator is inadequate, risk is avoided through vehicles state control 
equipment 54. 

[0068] Memory 50 memorizes the data used when presuming a lane as ideal rain width-of-face data 
5002. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) equivalent to a road 
color are beforehand memorized as control data 5004. Moreover, the data computed and presumed in 
each circuit are temporarily memorized as calculation data 5006. The ideal rain width-of-face data 
taking-in section 3210 is a means to incorporate the ideal rain width-of-face data 5002 held at memory 
50. 

[0069] Next, drawin g 7 explains operation of lane recognition processing. First, processing which 
determines the color conditions to extract is performed (Step SI 602). This processing is processing 
in_which extraction color condition data are determined using the data (Y, R-Y, B-Y) equivalent to the 
road color with which the color data (Y, R-Y, B-Y) of a specific (road position on a screen) pixel are 
sampled from the inside of an image pck-up picture, next the extraction color condition determination 
section 38 has been first remembered to be beforehand in the control data section 5004 of the data and 
memory 50 in the extraction processing circuit 36. The extraction color condition data decided here are 
Y (minimum). < Y < Y (maximum) 
R-Y (minimum) < R-Y < R-Y (maximum) 
B-Y (minimum) < B-Y < B-Y (maximum) 

** — although it is data with width of face and a front road color is [ like ] applied, a lane and a forward 
vehicle are set up so that it may not be applied In addition, although extraction color condition data were 
determined based on the sampled data and the data set up beforehand in this example, it is also possible 
to determine extraction color condition data (for example, for it to set up beforehand according to 
brightness conditions) only using the data set up beforehand. 

[0070] Next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction 
color condition data transmitted from the extraction color condition determination section 38 to an 
image pck-up picture, and performs processing which transmits the coordinate data (edge coordinate 
data) of the beginning (standup) to the pixel on a level line, and the last (falling) to the edge judgment 
section 3206 (Step SI 604). That is, the edge point which faces across a road field (self- vehicle lane) is 
extracted. 

[0071] Processing here is explained in detail, the pixel which the extraction method detected all the 
pixels in one frame which has a color belonging to the range of extraction color condition data in an 
image pck-up signal (Y, R-Y, B-Y), and was detected as shown in drawing 8 -- High"l - " - it is the 
technique of giving the binary-ized data which set the other pixel to Low "0" Pixel data search the pixel 
which changes to High "1" from Low "0", or Low "0" from High "1" for every line (that is, the rising 
edge from Low "0" to High "1" and the falling edge from High "1" to Low "0" are detected.). When 
such a pixel exists, let the position which is the pixel concerned be edge coordinate data. Existence of 
the pixel which is applied to extraction color condition data in one line with edge coordinate data can be 
grasped, and the field inserted into the edge coordinate data turns into a road field. 
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[0072] Next, to the edge coordinate data sent from the extraction processing circuit 36, the edge 
judgment section 3206 judges whether they are left lane edge data, right lane edge data, and the other 
edge point data (forward vehicle edge data), and performs processing to classify (Step SI 606). 
[0073] In this processing (Step SI 606), edge data are judged based on the feature of the edge coordinate 
data sent from the extraction processing circuit 36. Edge coordinate data starts and consists of 
information on falling, and information on the coordinate of each edge. Generally, when a road color is 
used as extraction color condition data, a rising edge turns into a left lane edge, and a right lane edge and 
a bird clapper have many falling edges. However, when a forward vehicle, an obstruction, etc. exist in a 
front road field, edges other than a lane will also be recognized as a lane edge. Then, the falling edge of 
the left lane edge data 14 and the right is used as the right lane edge data 16 for the rising edge on the 
left of the screen centerline 18, and the other edge is distinguished as forward vehicle edge data. In this 
example, although distinguished using the screen center line 18, it is also possible to use the line which 
connects the intersection and the screen lower central point 20 of the right-and-left recognition lane 
described later instead of the screen center line 18. 

[0074] If edge data are distinguished by the above, the edge judgment section 3206 will transmit the 
edge data 14 and 16 of a right-and-left lane to the lane calculation section 3208, and will transmit 
forward vehicle edge data to the danger judgment section 3204, respectively. 

[0075] Next, the lane calculation section 3208 makes a linearity judgment based on the right-and-left 
lane edge data 14 and 16 transmitted from the edge judgment section 3206, and computes the candidate 
lane to each lane edge data (Step SI 608). 

[0076] Next, the lane presumption section 3212 presumes the right-and-left lane (recognition lane) 
which should be recognized out of the candidate lane transmitted from the lane calculation section 3208 
based on the ideal rain width-of-face data 5002 of memory 50 incorporated fi-om the ideal rain width-of- 
face data taking-in section 3210, and transmits to the danger judgment section 3204 (Step SI 610). 
[0077] next, in danger presumption processing (Step SI 61 2) the signal from the vehicles state sensors (a 
vehicle speed sensor, a foot brake, a turn signal, steer angle sensor, etc.) 56 - a self-rolling-stock-run 
state (the vehicle speed --) The road surface which judged deceleration, lane change will, the amount of 
steer steering, etc., and has been recognized by the judgment result and the above-mentioned lane 
presumption section 3212 and which can be run. The danger (distance with a forward vehicle, relative 
velocity, the side existence of a vehicle, wandering of self-vehicles, etc.) over self-vehicles is presumed 
from the relation of the forward vehicle edge data transmitted from the edge judgment section 3206. In 
this step SI 61 2, when danger has not reached a predetermined value, the danger judgment section 3204 
returns processing to image pck-up data incorporation processing (Step S8). 

[0078] The danger judgment section 3204 performs alarm processing according to the presumed danger 
(Step S1614). In this alarm processing, the danger judgment section 3204 reports the presumed danger 
to the operator of a self-vehicle using the sound equipments (for example, voice, an alarm tone, etc.) 52 
or processing result monitor lamp 40 grade. For example, an operator can be made to recognize danger 
by enlarging an alarm tone, so that danger is large, or carrying out the voice output of the message of the 
contents defined according to danger. In this step S 1614, if an operator detects having performed 
suitable operation after alarm processing through the vehicles state sensor 56 and the vehicles state 
judgment section 3202, the danger judgment section 3204 will return processing to image pck-up data 
incorporation processing (Step S8). 

[0079] If an operator does not perform suitable operation in a predetermined time, according to the 
presumed danger, the danger judgment section 3204 performs risk-aversion processing (Step SI 61 6), 
and returns it to image pck-up data incorporation processing (Step S8). In this risk-aversion processing, 
the danger judgment section 3204 changes the control characteristic of vehicles kinematic-control 
equipment 54, or avoids risk by what is made to operate automatically (for example, braking is applied). 
[0080] b. the installation setting mode of lane recognition processing - below, explain the installation 
setting mode of lane recognition processing In case this mode performs the position of an image pck-up 
system for execution in lane recognition mode, and adjustment of an angle, it is the mode in which an 
operator is guided so that it may become a suitable position and a suitable angle. 
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[0081] The composition of the judgment section 32 for realizing installation setting mode of lane 
recognition processing is shown in drawing 12 . In order to realize installation setting mode of lane 
recognition processing, the judgment section 32 is equipped with the edge judgment section 3206, the 
lane calculation section 3208, the lane presumption section 3212, the ideal rain width-of-face data 
taking-in section 3210, and the lane recognition setting position judgment section 3214. 
[0082] It is the circuit which the edge judgment section 3206 judges whether the kinds (starting falling, 
a coordinate position, etc.) of edge coordinate data sent from the extraction processing circuit 36 are left 
lane edge data, right lane edge data, and the other edge point data, and is classified. And the other edge 
data (forward vehicle edge data) are transmitted for the edge data of a right-and-left lane to the lane 
calculation section 3208 at the danger judgment section 3204. 

[0083] The lane calculation section 3208 makes a linearity judgment based on the right-and-left lane 
edge data transmitted from the edge judgment section 3206, and computes the candidate lane to each 
lane edge data. 

[0084] The lane presumption section 3212 presumes the right-and-left lane (recognition lane) which 
should be recognized out of the candidate lane transmitted from the lane calculation section 3208 based 
on the ideal rain width-of-face data 5002 of memory 50 incorporated from the ideal rain width-of-face 
data taking-in section 3210, and transmits to the lane recognition setting position judgment section 3214. 

[0085] It asks for the intersection of the recognition lane on either side and the level line of the bottom 
of an image pck-up screen which were transmitted from the lane presumption section 3212 in the lane 
recognition setting position judgment section 3214. And a setting degree is presumed by in which 
position on the level line of the bottom of an image pck-up screen the intersection for which it asked is, 
and it reports to an operator through sound equipment 52. 

[0086] Memory 50 memorizes the data used when presuming a lane as ideal rain width-of-face data 
5002. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) equivalent to a road 
color are beforehand memorized as control data 5004. Moreover, the data computed and presumed in 
each circuit are temporarily memorized as calculation data 5006. The ideal rain width-of-face data 
taking-in section 3210 is a means to incorporate the ideal rain width-of-face data 5002 held at memory 
50. 

[0087] Next, processing in the installation setting mode lane recognition processing is explained using 
drawing 13 . First, processing which determines the color conditions to extract is performed (Step 
SI 602). This processing is processing which determines extraction color condition data using the data 
(Y, R-Y, B-Y) equivalent to the road color to which the extraction condition determination section 38 is 
first remembered to be the data beforehand in the control data section 5004 of memory 50 in the 
extraction processing circuit 36 by sampling the color data (Y, R-Y, B-Y) of a specific (road position on 
a screen) pixel from the inside of an image pck-up picture next. The extraction color condition data 
decided here are Y (minimum). < Y < Y (maximum) 
R-Y(minimum) <R-Y<R-Y (maximum) 
B-Y(minimum) <B-Y<B-Y (maximum) 

** " although it is data with width of face and a front road color is [ like ] applied, a lane and a forward 
vehicle are set up so that it may not be applied In addition, although extraction color condition data were 
determined based on the sampled data and the data set up beforehand in this example, it is also possible 
to determine extraction color condition data (for example, for it to set up beforehand according to 
brightness conditions) only using the data set up beforehand. 

[0088] next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction color 
condition data transmitted from the extraction condition determination section 38 to an image pck-up 
picture, extracts the coordinate data (edge coordinate data) of the beginning (standup) to the pixel on a 
level line, and the last (falling) (namely, the edge point which faces across a road field (self-vehicle 
lane) - extracting), and transmits it to the edge judgment section 3206 (Step SI 604) 
[0089] To the edge coordinate data sent from the extraction processing circuit 36, the edge judgment 
section 3206 which received the notice of edge coordinate data judges any of left lane edge data, right 
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lane edge data, and the other edge point data (forward vehicle edge data) they are, and performs 
processing to classify (Step SI 606). 

[0090] In this processing (Step SI 606), edge data are judged based on the feature of the edge coordinate 
data sent from the extraction processing circuit 36, and the edge data 814 and 816 of a right-and-left lane 
are transmitted to the lane calculation section 3208. Edge coordinate data starts and consists of 
information on falling, and information on the coordinate of each edge. Generally, when a road color is 
used as extraction color condition data, a rising edge turns into a left lane edge, and a right lane edge and 
a bird clapper have many falling edges. However, when a forward vehicle, an obstruction, etc. exist in a 
front road field, edges other than a lane will also be recognized as a lane edge. Then, as shown in 
drawin g 8 , the falling edge of the left lane edge data 814 and the right is used as the right lane edge data 
816 for the rising edge on the left of the screen centerline 818, and the other edge is distinguished as 
forward vehicle edge data. 

[0091] The lane calculation section 3208 which received the notice of edge data makes a linearity 
judgment based on the right-and-left lane edge data 814 and 816 transmitted from the edge judgment 
section 3206, and computes the candidate lane to each lane edge data (Step SI 608). 
[0092] Next, the lane presumption section 3212 presumes the right-and-left lane (recognition lane) 
which should be recognized out of the candidate lane transmitted from the lane calculation section 3208 
based on the ideal rain width-of-face data 5002 of memory 50 incorporated from the ideal rain width-of- 
face data taking-in section 3210, and transmits to the setting position judgment section 3214 (Step 
S1610). 

[0093] Next, the setting position judgment section 3214 asks for the intersection of the right-and-left 
lane recognized by the above-mentioned lane presumption section 3212 and the level line of the bottom 
of an image pck-up screen, and performs setting position presumption processing (Step SI 622) in which 
a setting degree is presumed by in which position on the level line of the bottom of an image pck-up 
screen the intersection is. 

[0094] Furthermore, the setting position judgment section 3214 performs information processing (Step 
SI 624) which takes out voice, an alarm tone, etc. from sound equipment 52 according to the setting 
degree presumed in the lane recognition setting position judgment section 3214, and returns processing 
to image pck-up data taking-in processing (Step S8). A setting degree is reported to the operator of a 
self-vehicle by this information processing. 

[0095] c. nap alarm mode - below, explain nap alarm mode The composition of the judgment section 32 
for realization in nap alarm mode is shown in drawin g 14 . The judgment section 32 is equipped with the 
face position judgment section 3216, the eye judgment section 3218, the vehicles state judgment section 
3202, and the degree judgment section 3220 of awakening for realization in nap alarm mode. 
[0096] The face position judgment section 3216 is a circuit which the extraction coordinate data sent 
from the extraction processing circuit 36 judges whether it is data of an operator's face, and classifies. 
And the extraction coordinate data of an operator's face is transmitted to the eye judgment section 3218, 
the extraction condition determination section 38, and the degree judgment section 3220 of awakening. 
[0097] From the edge data transmitted from the extraction processing circuit 36 based on the data of the 
face of the operator transmitted from the face position judgment section 3216, the eye judgment section 
3218 presumes the opening of an operator's eyes, and transmits to the degree judgment section 3220 of 
awakening. 

[0098] With the signal from the vehicles state sensor 56, the vehicles state judgment section 3202 judges 
a self-rolling-stock-run state, and transmits the judgment result to the degree judgment section 3220 of 
awakening. 

[0099] In the degree judgment section 3220 of awakening, the movement of the head is recognized by 
the face data transmitted from the face position judgment section 3216, a blink of an operator is 
recognized by the opening of the eye transmitted from the eye judgment section 3218, and the run state 
of a self-vehicle is recognized by the data transmitted from the vehicles state judgment section 3202. 
And an operator's degree of awakening is presumed in consideration of those three elements. Here, when 
it is presumed that the degree of awakening is low, it reports to an operator through sound equipment 52. 
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Furthermore, when there is no change in an operator's degree of awakening, the temperature of the 
vehicle interior of a room is lowered through the vehicles state control equipments 54 (for example, air- 
conditioner etc.). 

[0100] Memory 50 memorizes beforehand the data used when presuming the degree of awakening as 
presumed data 5008. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) 
equivalent to the color of a face and the hair are beforehand memorized as control data 5004. Moreover, 
the data computed and presumed in each circuit are temporarily memorized as calculation data 5006. 
[0101] Next, the procedure of nap alarm processing is shovra in drawing 15 . First, processing which 
determines the color conditions to extract is performed (Step SI 602). This processing is processing 
which determines extraction color condition data using the face with which the color data (Y, R-Y, B-Y) 
of a specific (the face on a screen, hair position) pixel are sampled from the inside of an image pck-up 
picture, next the extraction condition determination section 38 has been first remembered to be 
beforehand in the control data section 5004 of the data and memory 50 in the extraction processing 
circuit 36, and the data (Y, R-Y, B-Y) equivalent to the color of the hair. The extraction color condition 
data decided here are Y (face minimum). < Y < Y (face maximum) 
R-Y(face minimum) <R-Y<R-Y (face maximum) 
B-Y(face minimum) <B-Y<B-Y (face maximum) 
Y (hair minimum) < Y < Y (hair maximum) 
R-Y(hair minimum) <R-Y<R-Y (hair maximum) 
B-Y(hair minimum) <B-Y<B-Y (hair maximum) 

** " it is two kinds of data with width of face like, and they are the conditions for performing 
binarization by whether at least one side is filled among this data, or it does not fill That is, although the 
color of a face or the hair is applied, the color of a sheet, dress, etc. is set up so that it may not be 
applied. In addition, although extraction color condition data were determined based on the sampled data 
and the data set up beforehand in this example, it is also possible to determine extraction color condition 
data (for example, for it to set up beforehand according to brightness conditions) only using the data set 
up beforehand. 

[0102] Next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction 
color condition data transmitted from the extraction condition determination section 38 to an image pck- 
up picture, and performs processing v^^hich transmits the coordinate data (edge coordinate data) of the 
beginning (standup) to the pixel on a level line, and the last (falling) to the eye judgment section 3218 
(Step SI 604). Furthermore, the extraction processing circuit 36 asks for the position and size (extraction 
coordinate data) of a circumscription square on an image pck-up screen from the meeting of the pixel 
equivalent to extraction color condition data, and performs processing transmitted to the face position 
judgment section 3214 (Step SI 632). 

[0103] From two or more extraction coordinate data transmitted from the extraction processing circuit 
36, the face position judgment section 3216 which received data computes the position of an operator's 
head, and transmits the position data to the eye judgment section 3218, the extraction condition 
determination section 38, and the vigilance judgment section 3220, respectively (Step SI 634). 
[0104] From the position data transmitted from the face position judgment section 3216, the eye 
judgment section 3218 which received transmission of data presumes the position and opening of an eye 
from two or more edge coordinate data from the extraction processing circuit 36, and transmits the 
opening of an eye to the vigilance judgment section 3220 (Step S1636). 

[0105] Next, from the position data of the head of the operator transmitted from the face position 
judgment section 3216, the vigilance judgment section 3220 recognizes the movement of a head, and 
presumes an operator's vigilance by the opening of the eye transmitted from the eye judgment section 
3218 further (Step SI 638). 

[0106] The vigilance presumed in Step 1638 a low case from a predetermined value the vigilance 
judgment section 3220 When an operator is awoke through the vehicles state control equipments 54 (for 
example, a sheet driving gear, a steer rocking equipment, etc.) (Step SI 640) and an operator's vigilance 
becomes again low It is reported that the temperature of the vehicle interior of a room is lowered 
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through the vehicles state control equipments 54 (for example, air-conditioner etc.), or a break is taken 
to an operator through sound equipment 52 according to vigilance (Step SI 640). 
[0107] d. Explain the installation setting mode of a nap alarm as the fourth mode of installation setting 
mode of a nap alarm. In case this mode performs the position of an image pck-up system for execution 
in nap alarm mode, and adjustment of an angle, it is the mode in which an operator is guided so that it 
may become a suitable position and a suitable angle. 

[0108] In nap alarm mode, as shown in drawing 16 , to set up so that an operator's face may become the 
size whose size of the face reflected in the display screen so that it may come to a mid gear mostly of the 
display screen is about [ of the display screen ] 2/3 is desired. Then, it is necessary to set up an image 
pck-up system beforehand so that two thirds of the setting target frames of a size of the display screen 
may be prepared near the center of the display screen and an operator's face may be subsided within this 
limit on the occasion of execution in nap alarm mode. In the installation setting mode of a nap alarm, 
while displaying the physical relationship of a setting target frame and an operator's face on a drop and 
telling an operator about it at the time of the position of an image pck-up system, and a setup of an 
angle, it notifies whether the face is settled within the limit by dial tone, this example - drawin g 

16 " being shown - as - a face - within the limit - being settled ~ a case --****- being long 

- dial tone - " -- PI - " - generating - making drawing 17 - like - a face - within the limit - being 
settled - ****-. a case being short - dial tone - " - PIPPIPPITSU - " - generating - 

making - things - a setup of an image pck-up system - supporting . 

[0109] The composition of the judgment section 32 for realization in the installation setting mode of a 
nap alarm is shown in drawing 18 . The judgment section 32 is equipped with the face position judgment 
section 3216 and the nap alarm attaching position judgment section 3222 for realization in the 
installation setting mode of a nap alarm. 

[0110] The face position judgment section 3216 is a circuit which the extraction coordinate data sent 
from the extraction processing circuit 36 judges whether it is data of an operator's face, and classifies. 
And the extraction coordinate data of an operator's face is transmitted to the extraction condition 
determination section 38 and the nap alarm attaching position judgment section 3222. 
[01 11] In the nap alarm attaching position judgment section 3222, it recognizes how an operator's head 
is reflected to the image pck-up screen by the face data transmitted from the face position judgment 
section 3216, and an installation setting degree is presumed. Here, when a setting degree presumes a 
low, it reports to an operator through sound equipment 52. 

[0112] Memory 50 memorizes beforehand the data used when presuming a setting degree as setting data 
5010. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) equivalent to the 
color of a face and the hair are beforehand memorized as control data 5004. Moreover, the data 
computed and presumed in each circuit are temporarily memorized as calculation data 5006. 
[0113] Below, the flow of processing in the installation setting mode of a nap alarm is explained using 
drawin g 19 . 

[0114] First, processing which determines the color conditions to extract is performed (Step SI 602). 
This processing is processing which determines extraction color condition data using the face with 
which the color data (Y, R-Y, B-Y) of a specific (the face on a screen, hair position) pixel are sampled 
from the inside of an image pck-up picture, next the extraction condition determination section 38 has 
been first remembered to be beforehand in the control data section 5004 of the data and memory 50 in 
the extraction processing circuit 36, and the data (Y, R-Y, B-Y) equivalent to the color of the hair. The 
extraction color condition data decided here are Y (face minimum). < Y < Y (face maximum) 
R-Y(face minimum) <R-Y<R-Y (face maximum) 
B-Y(face minimum) <B-Y<B-Y (face maximum) 
Y (hair minimum) < Y < Y (hair maximum) 
R-Y(hair minimum) <R-Y<R-Y (hair maximum) 
B-Y(hair minimum) <B-Y<B-Y (hair maximum) 

** " it is two kinds of data with width of face like, and they are the conditions for performing 
binarization by whether at least one side is filled among this data, or it does not fill That is, although the 
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color of a face or the hair is applied, the color of a sheet, dress, etc. is set up so that it may not be 
applied. In addition, although extraction color condition data were determined based on the sampled data 
and the data set up beforehand in this example, it is also possible to determine extraction color condition 
data (for example, for it to set up beforehand according to brightness conditions) only using the data set 
up beforehand. 

[0115] Next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction 
color condition data transmitted from the extraction condition determination section 38 to the picturized 
image data. It asks for the coordinate data (edge coordinate data) of the beginning (standup) to the pixel 
on a level line, and the last (falling) (Step SI 604). It asks for the position and size (extraction coordinate 
data) of a circumscription square on an image pck-up screen from the meeting of the pixel equivalent to 
extraction color condition data, and transmits to the nap alarm attaching position setting judgment 
section 3222 (Step SI 632). 

[0116] Next, the face position judgment section 3216 computes the position of an operator's head from 
two or more extraction coordinate data transmitted from the extraction processing circuit 38, and 
performs processing which transmits the position data to the nap alarm attachment setting position 
judgment section 3222 (Step SI 634). 

[0117] From the position data transmitted from the face position judgment section 3216, the nap alarm 
attachment setting position judgment section 3222 which received transmission computes a setting 
degree (Step SI 642), and reports it to a configurator by the computed setting degree using sound 
equipment 52 (Step SI 644). 

[0118] e. load balance mode -- below, explain load balance mode In this example, load balance mode is 
applicable also about the arrangement balance of a cargo by changing extraction color condition data, 
although it is the mode in which crew's arrangement balance is detected. Moreover, when there is a 
correspondence relation to a color and weight, this correspondence relation is beforehand held in 
memory 50, and you may make it ask for the load balance in consideration of the weight of each cargo 
in addition to arrangement. 

[0119] In this load balance mode, an image pck-up screen is expected to be set up so that a driver's seat, 
a passenger seat, and a backseat may be picturized. When it is set as the position of drawing 20 and 
performs this mode, the setting target frame at this time needs to set up the position and angle of an 
image pck-up system beforehand so that an operator's face may be subsided within this limit. 
[0120] In this load balance mode, the face of the man in an image pck-up picture is extracted, and it asks 
for crew arrangement, as shown in drawing 21 , a crew arrangement position is displayed, further, this 
data is transmitted to vehicles kinematic-control equipment 54, and control to the imbalance of a crew 
position is performed. A suspension system, an air-conditioner, the air back, etc. can be used for 
vehicles kinematic-control equipment 54. Using an air-conditioner and a suspension system as vehicles 
kinematic-control equipment 54, according to arrangement of crew, the wind direction of an air- 
conditioner and air capacity are controlled by this example, and the control state of a suspension is 
further changed by it according to the balance of a crew position. In addition, the painting-out 
concentration of a triangular display expresses the control state of a suspension in drawing 21 . 
[0121] The composition of the judgment section 32 for realizing this load balance mode is shown in 
drawin g 22 . In order to realize load balance mode, the judgment section 32 is equipped with the face 
position judgment section 3216 and the load balance judgment section 3224. 

[0122] The extraction coordinate data sent from the extraction processing circuit 36 judges whether it is 
data of the face of an operator and a fellow passenger, classifies the face position judgment section 
3216, and it transmits the extraction coordinate data of the face of an operator and a fellow passenger to 
the extraction condition determination section 38 and the load balance judgment section 3224. 
[0123] The load balance judgment section 3224 recognizes the position and the number of the head by 
the face data transmitted from the face position judgment section 3216, and guesses whether you are a 
child or an adult with the position of the head. And space in which transmits these data to the vehicles 
state control equipments 54 (for example, air-conditioner etc.), and people are present is made into a 
proper state. 
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[0124] Memory 50 memorizes beforehand the data used when presuming load balance as presumed data 
5012. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) equivalent to the 
color of a face and the hair are beforehand memorized as control data 5004. Moreover, the data 
computed and presumed in each circuit are temporarily memorized as calculation data 5006. 
[0125] The flow of processing in this load balance mode is explained using drawing 23 . First, 
processing which determines the color conditions to extract is performed (Step SI 602). In the extraction 
processing circuit 36, as for this processing, the color data (Y, R-Y, B-Y) of a specific (the face on a 
screen, hair position) pixel are sampled from the inside of an image pck-up picture, next the extraction 
condition determination section 38 is processing which determines extraction color condition data using 
the face beforehand memorized in the control data section 5004 of the data and memory 50, and the data 
(Y, R-Y, B-Y) equivalent to the color of the hair. The extraction color condition data decided here are Y 
(face minimum). < Y < Y (face maximum) 
R-Y(face minimum) <R-Y<R-Y (face maximum) 
B-Y(face minimum) <B-Y<B-Y (face maximum) 
Y (hair minimum) < Y < Y (hair maximum) 
R-Y(hair minimum) <R-Y<R-Y (hair maximum) 
B-Y(hair minimum) <B-Y<B-Y (hair maximum) 

** - it is two kinds of data with width of face like, and they are the conditions for performing 
binarization by whether at least one side is filled among this data, or it does not fill That is, although the 
color of a face or the hair is applied, the color of a sheet, dress, etc. is set up so that it may not be 
applied. In addition, although extraction color condition data were determined based on the sampled data 
and the data set up beforehand in this example, it is also possible to determine extraction color condition 
data (for example, for it to set up beforehand according to brightness conditions) only using the data set 
up beforehand. 

[0126] Next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction 
color condition data transmitted from the extraction condition determination section 38 to an image pck- 
up picture. Processing which asks for the coordinate data (edge coordinate data) of the beginning 
(standup) to the pixel on a level line and the last (falling) is performed (Step SI 604). It asks for the 
position and size (extraction coordinate data) of a circumscription square on an image pck-up screen 
from the meeting of the pixel equivalent to extraction color condition data, and processing transmitted to 
the face position judgment section 3216 is performed (Step S1632). 

[0127] The face position judgment section 3216 which received the extraction coordinate data computes 
the position of the head of an operator and a fellow passenger from two or more extraction coordinate 
data transmitted from the extraction processing circuit 36, and transmits the position data to the load 
balance judgment section 3224 (Step SI 634). 

[0128] From the position data transmitted from the face position judgment section 3216, the load 
balance judgment section 3224 which received this presumes the number and weight of an operator and 
a fellow passenger (Step SI 656), the number and the weight which were presumed are displayed on the 
display screen of a drop 302 (Step SI 658), and if load balance is a predetermined range, it will return 
processing to image pck-up data taking-in processing (Step S8). 

[0129] If there is no load balance within the limits of predetermined, the load balance judgment section 
3224 will transmit the number and the weight which were presumed to vehicles kinematic-control 
equipment 54 (Step SI 660), and will return processing to image pck-up data taking-in processing (Step 
S8). The vehicles kinematic-control equipment 54 which received the notice with this number and 
weight that were presumed performs control processing (for example, processing which changes the 
control state of a suspension) beforehand defined according to balance. 

[0130] f. mirror mode - below, explain mirror mode Mirror mode is the mode which displays crew's 
face on the display screen of a drop 302. In this example, as shown in drawing 3 , the sun visor 1 1 1 is 
put in order and equipped with a mirror 304 and the display screen 302. Then, if crew's profile is 
displayed on a drop 302, since a front face will be reflected to a mirror 304, a front face and a front 
profile can be seen simultaneously and facilities, such as a remodeling of the woman in a passenger seat, 
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can be given especially. Without moving an image pck-up system, the image display equipment of this 
example performs extraction processing so that people's face may always be greatly outputted to a 
display screen center section. 

[0131] The composition of the judgment section 32 for realizing mirror mode is shown in drawin g 24 . 
In order to realize mirror mode, the judgment section 32 is equipped with the face position judgment 
section 3216. This face position judgment section 3216 is a means for the extraction coordinate data sent 
from the extraction processing circuit 36 to judge whether it is data of an operator's face, to classify, and 
to transmit the extraction coordinate data of an operator's face to the extraction condition determination 
section 38. The extraction condition determination section 38 which received this recognizes the 
movement of the head by the face data transmitted from the face position judgment section 3216, and 
displays that an image pck-up screen is shifted and a face comes in the center of the display screen. 
[0132] Memory 50 memorizes beforehand the data used when presuming the movement of the head as 
presumed data 5014. Moreover, the data which control this equipment, and the data (Y, R-Y, B-Y) 
equivalent to the color of a face and the hair are beforehand memorized as control data 5004. Moreover, 
the data computed and presumed in each circuit are temporarily memorized as calculation data 5006. 
[0133] The flow of processing in mirror mode is shown in drawing 25 . First, a line is performed in the 
processing which determines the color conditions to extract (Step SI 602). This processing is processing 
which determines extraction color condition data using the face with which the color data (Y, R-Y, B-Y) 
of a specific (the face on a screen, hair position) pixel are sampled from the inside of an image pck-up 
picture, next the extraction condition determination section 38 has been first remembered to be 
beforehand in the control data section 5004 of the data and memory 50 in the extraction processing 
circuit 36, and the data (Y, R-Y, B-Y) equivalent to the color of the hair. The extraction color condition 
data decided here are Y (face minimum). < Y < Y (face maximum) 
R-Y(face minimum) <R-Y<R-Y (face maximum) 
B-Y(face minimum) <B-Y<B-Y (face maximum) 
Y (hair minimum) < Y < Y (hair maximum) 
R-Y(hair minimum) <R-Y<R-Y (hair maximum) 
B-Y(hair minimum) <B-Y<B-Y (hair maximum) 

** - it is two kinds of data with width of face like, and they are the conditions for performing 
binarization by whether at least one side is filled among this data, or it does not fill That is, although the 
color of a face or the hair is applied, the color of a sheet, dress, etc. is set up so that it may not be 
applied. In addition, although extraction color condition data were determined based on the sampled data 
and the data set up beforehand in this example, it is also possible to determine extraction color condition 
data (for example, for it to set up beforehand according to brightness conditions) only using the data set 
up beforehand. 

[0134] Next, the extraction processing circuit 36 discriminates the pixel equivalent to the extraction 
color condition data transmitted from the extraction condition determination section 38 to an image pck- 
up picture, and performs processing which asks for the coordinate data (edge coordinate data) of the 
beginning (standup) to the pixel on a level line, and the last (falling) (Step SI 604). Next, the extraction 
processing circuit 36 asks for the position and size (extraction coordinate data) of a circumscription 
square on an image pck-up screen from the meeting of the pixel equivalent to extraction color condition 
data, and performs processing transmitted to the face position judgment section 3216 (Step SI 632). 
[0135] The face position judgment section 3216 which received this transmission computes the position 
of an operator's head from two or more extraction coordinate data transmitted from the extraction 
processing circuit 36, and performs processing which transmits the position data to the extraction 
condition determination section 38 (Step SI 634). 

[0136] Next, the extraction condition determination section 38 which received position data From the 
position data transmitted from the face position judgment section 3216, presume the movement of the 
head and the head sets to the display screen. A scale factor and the amount which shifts the display 
screen are decided so that it may be greatly reflected in the center (Step SI 672). Based on the data 
transmitted from the extraction condition determination section 38 in the image pck-up section 24, zoom 
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and the image pck-up range are moved (Step SI 674), and processing is returned to image pck-up data 

taking-in processing (Step S8). 

[0137] 

[Effect of the Invention] According to this invention, also in a gloomy situation, the situation besides in 
the car can be recognized with sufficient sensitivity, and it can process according to it. 



[Translation done.] 
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